-- Logs begin at Thu 2022-05-05 12:56:24 UTC, end at Thu 2022-05-05 14:45:21 UTC. -- May 05 13:33:02.145045 dv-cinder-737618-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 05 13:33:02.153638 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 05 13:33:02.156244 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 13:33:02 2022] *** May 05 13:33:02.156389 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 13:33:02.156507 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 13:33:02.156610 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: nodename: dv-cinder-737618-3-iscsi May 05 13:33:02.156707 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: machine: x86_64 May 05 13:33:02.156813 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: clock source: unix May 05 13:33:02.156922 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: pcre jit disabled May 05 13:33:02.157026 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: detected number of CPU cores: 4 May 05 13:33:02.157129 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: current working directory: / May 05 13:33:02.157233 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: detected binary path: /usr/bin/uwsgi-core May 05 13:33:02.157336 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: your processes number limit is 47680 May 05 13:33:02.157446 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: your memory page size is 4096 bytes May 05 13:33:02.157551 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: detected max file descriptor number: 2048 May 05 13:33:02.157665 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: lock engine: pthread robust mutexes May 05 13:33:02.157935 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: thunder lock: enabled May 05 13:33:02.158156 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 05 13:33:02.158243 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 13:33:02.204184 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: Python main interpreter initialized at 0x55fd202279c0 May 05 13:33:02.204184 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: python threads support enabled May 05 13:33:02.204184 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: your server socket listen backlog is limited to 100 connections May 05 13:33:02.204184 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: your mercy for graceful operations on workers is 90 seconds May 05 13:33:02.204513 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: mapped 403077 bytes (393 KB) for 2 cores May 05 13:33:02.204589 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: *** Operational MODE: preforking *** May 05 13:33:02.204885 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: *** uWSGI is running in multiple interpreter mode *** May 05 13:33:02.204885 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: spawned uWSGI master process (pid: 86642) May 05 13:33:02.205091 dv-cinder-737618-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 05 13:33:02.210038 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: spawned uWSGI worker 1 (pid: 86653, cores: 1) May 05 13:33:02.210038 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: spawned uWSGI worker 2 (pid: 86654, cores: 1) May 05 13:33:02.210038 dv-cinder-737618-3-iscsi devstack@keystone.service[86642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 13:33:07.982582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:33:07.982582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: from cryptography.utils import int_from_bytes May 05 13:33:07.986420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:33:07.986420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: from cryptography.utils import int_from_bytes May 05 13:33:07.986548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:33:07.986548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: from cryptography.utils import int_from_bytes May 05 13:33:07.986548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:33:07.986548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: from cryptography.utils import int_from_bytes May 05 13:33:08.036986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:33:08.037145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:33:08.037233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:33:08.037324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:33:08.037408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] command line args: [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:33:08.037489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] command line args: [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:33:08.037599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:33:08.037716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:33:08.037798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ================================================================================ {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:33:08.037879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ================================================================================ {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:33:08.038045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] admin_token = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] admin_token = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] config_dir = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] config_dir = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] config_source = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] config_source = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.038871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] debug = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.039026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] debug = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.039116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.040577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.040717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.040836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.040921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_config_append = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_config_append = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.041970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_dir = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_dir = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_file = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_file = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.042957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.043982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.044963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] publish_errors = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] publish_errors = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.045991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] standard_threads = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] standard_threads = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.046930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] use_journal = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] use_journal = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] use_json = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] use_json = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] use_stderr = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] use_stderr = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] use_syslog = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] use_syslog = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.047901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:33:08.048076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.048879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.049841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.050988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.051934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.052985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.053985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.054157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.054237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.054385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.054473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.055924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.056852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.057950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.058962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.059902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.060994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.061927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.062973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.063915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.064882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.065982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.066948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.067966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.068953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.069897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.070064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.070148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.070870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.070976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.071879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.072975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.073920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.external = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.external = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.074983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.password = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.password = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] auth.token = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] auth.token = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.075889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.076852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.077950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.078929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.079934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.080956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.081999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.082983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.083944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.084907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.085879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.086861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.087964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.088957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.089965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.090946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.091898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.092857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093692 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.093900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.094997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.095936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.096969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.097989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.098996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.099931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.100911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.101771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.102936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.103976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.104931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.105883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.106846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] role.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] role.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] role.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] role.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.107932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.108982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.109938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.110943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.111977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.112934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.113957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.114941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.115885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.116820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.117502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.117589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.117744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.117835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.117987 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.118969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.119998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.connection = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.120996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.connection = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121692 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.121926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.122864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.123954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.124957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.125031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:33:08.125104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:33:08.125266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:33:08.156456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.156681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.156825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.156912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.157056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.157279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.166190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.166630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.194390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.194617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.194820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.195052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.247168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.247577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.298560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.298785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.299537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.299774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.364745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.364967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.365855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.366031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.366263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.366482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.366697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.389488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.389701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.389794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.389921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.390991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.402112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.402458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.416860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.417957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.418054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.418190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86653) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.418286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.418402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.418616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86654) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 13:33:08.435680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.435888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 13:33:08.436156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.436241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.436366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 13:33:08.436449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 13:33:08.436657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.436765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.436884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 13:33:08.436968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.437895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.449193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.449467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.449729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.449824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.450004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.450114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.450362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.450640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.458030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.458706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.461826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.462126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.462403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.462537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.462784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.462869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.463983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.464793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.465032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.465293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.490650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.491493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.492264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.492536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.493122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.493397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.497745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.497980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.498278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.498653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.498927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.499204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.505420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.505694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.506429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.506709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.510782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.511064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.511341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.511612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.511817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.511901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.512913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.513182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.513446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.513708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.531017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.531288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.532246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.532520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.535732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.537001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.539832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.540118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.541116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.541407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.545008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.546434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.548538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.549970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.552302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.552592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.552868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.553150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.553421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.553678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.553771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.553971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.554273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.554601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.555369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.555630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.573069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.573441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.573705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.573962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.574660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.575033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.575300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.575562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.581708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.583396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.583498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.583681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.585094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.585364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.587211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.587484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.587772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.588043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.588311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.588940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.589215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.589507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.589786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.590081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.601559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.602342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.602614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.602888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.603168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.603435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.603709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.603980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.604254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.604531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.604806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.605082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.605353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.605632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.621433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.623699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.624663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.626957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.627952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.629508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.630280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.631137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.631410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.631692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.631864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.633500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.633775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.634096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.639010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.640593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.641396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.643022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.643866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.644149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.644431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.644699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.646221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.646511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.646799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.647072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.654383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.654673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.654948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.656682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.656973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.657259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.662961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86653) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.663237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.663511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.663787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.664257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.664706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.665174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.665465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86654) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 13:33:08.665650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.665779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.665999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.666154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.666289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.666560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.666687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.666825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.667993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.668145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.668401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.668553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86653) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.668728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.668915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86654) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 13:33:08.708569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd202279c0 pid: 86654 (default app) May 05 13:33:08.711995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547341f-eb52-42c1-a640-e54cfc3285dd None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:08.712287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547341f-eb52-42c1-a640-e54cfc3285dd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:08.712564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547341f-eb52-42c1-a640-e54cfc3285dd None None] PATH_INFO: `/v3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:08.714820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd202279c0 pid: 86653 (default app) May 05 13:33:08.716749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu May 5 13:33:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:17.510035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:17.513655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:17.513655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:17.514789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:17.519963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:17.520380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:17.520542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:17.551048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG oslo_db.sqlalchemy.engines [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:33:17.734552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG passlib.handlers.bcrypt [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86654) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 13:33:17.734983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG passlib.handlers.bcrypt [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86654) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 13:33:17.789910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:17.791456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:17.910746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 13:33:18.032543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:18.066658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG oslo_db.sqlalchemy.engines [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:33:18.192374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29564-8e93-4a49-b40d-cba07f653821 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:18.197529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:18.198209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:18.198495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:18.198771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:18.206890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:18.259944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 13:33:18.260282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c481a9f-5a8b-4ca8-88b1-5adf798c7c6d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:18.269614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu May 5 13:33:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:33:18.275568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:18.289935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0ad6-e080-4138-97ca-34a74af077c4 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:18.294313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:18.295434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:18.295717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:18.295990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] PATH_INFO: `/v3/projects/1c80cec912494f1282aea1889f985885` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:18.297493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] RBAC: Authorizing `identity:get_project(project_id=1c80cec912494f1282aea1889f985885)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:18.349483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING keystone.common.rbac_enforcer.enforcer [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 13:33:18.349821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b76d4-6393-4369-b727-7c081d152eab admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:18.354901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu May 5 13:33:18 2022] GET /identity/v3/projects/1c80cec912494f1282aea1889f985885 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:20.556674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c90b4e-ffec-4de1-84e0-a391b5363a84 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:20.557179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c90b4e-ffec-4de1-84e0-a391b5363a84 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:20.557179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c90b4e-ffec-4de1-84e0-a391b5363a84 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:20.561255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:20.566700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:20.567120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:20.567251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:20.587584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:20.589093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:20.596827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 05 13:33:20.619299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c90b4e-ffec-4de1-84e0-a391b5363a84 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:20.630945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c90b4e-ffec-4de1-84e0-a391b5363a84 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:20.635638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:20.636254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:20.636531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:20.636804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:20.644315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:20.646106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243396b4-24bc-42c9-98c3-9fc2fb8dae5f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:20.654617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu May 5 13:33:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:33:20.659699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:20.668830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56507682-3063-4707-be6f-d0912d4bfbdb None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:20.673351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:20.674237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:20.674520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:20.674800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:20.676198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:20.678043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748a562-8528-4e85-b7bf-216b58c7c7d6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:20.680086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu May 5 13:33:20 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:22.945018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c175db-e3a7-43a4-95b3-15f272e49e05 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:22.945553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c175db-e3a7-43a4-95b3-15f272e49e05 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:22.945553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c175db-e3a7-43a4-95b3-15f272e49e05 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:22.946940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:22.952215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:22.952647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:22.952885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.004918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d887f-1bb9-4e1b-922d-b7ac41e0d4a7 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.005209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d887f-1bb9-4e1b-922d-b7ac41e0d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.005490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d887f-1bb9-4e1b-922d-b7ac41e0d4a7 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.006896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:23.012852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.013133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.013406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.055464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG passlib.handlers.bcrypt [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86653) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 13:33:23.055889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG passlib.handlers.bcrypt [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86653) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 13:33:23.078522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:23.079718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:23.103160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:23.104746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:23.159799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:23.182848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.203336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:23.225375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.277661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d713-d7e3-42ac-86e6-b4d4bef2eb94 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.308865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.309652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.309930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.310229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.320523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c091797-229a-42b6-9c61-8b9f23e4f578 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.321563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:23.332484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:23.333391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:23.334354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:23.338157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:23.339418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.352934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.353834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.354143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.354414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.418363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.419883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.431960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d07-017a-4989-83ea-9ca9c4f3522f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.464092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.464669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.464944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.465208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.465950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:23.466277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.467638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.478820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:23.484184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.512654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:33:23.518079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.579719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229f479-c6ff-444e-aee7-5862706f0db9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.611015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405b88-20ae-47f8-bd7b-d34e71a7673c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.611179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.611987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.612268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.612540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.613743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.615223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.617401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:23.622812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.642760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.643538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.643811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.644081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.722592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec7c93-91e8-4440-bb40-684676297990 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.756546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.757384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.757668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.757943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.759176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.760637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.762292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:23.767966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.770558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.771999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:33:23.792767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:23.793681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:23.794547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:33:23.794547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:33:23.794547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:33:23.794547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:23.794547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:23.799545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:23.863614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79a3b-f87e-4ba5-ae4f-6e3df431b4a6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.893760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c099-7867-46c3-a1eb-41ec74ec768b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:23.894293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.894961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.895241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.895503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.896327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.domain.id=default, user.id=97db43a40c2a4364b17888ab2b4ef553) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:23.896629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.898591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d0bd-b88a-4218-a649-595923e7a1c5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.905145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/role_assignments?user.id=97db43a40c2a4364b17888ab2b4ef553&scope.domain.id=default&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:23.928185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:23.928874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:23.929156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:23.929431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:23.930210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:23.930517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:23.931961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8e17-2d05-4cf3-b496-49b8b0081b93 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:23.952010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:26.289987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc056-0e40-45c9-8561-b79e109c0576 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.291029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc056-0e40-45c9-8561-b79e109c0576 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.291584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc056-0e40-45c9-8561-b79e109c0576 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.293517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:26.298768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.299537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.299955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.327090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:26.328555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:26.411584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:26.442609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc056-0e40-45c9-8561-b79e109c0576 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:26.606698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc056-0e40-45c9-8561-b79e109c0576 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:26.646553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:26.647345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.647619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.648431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.663116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-1978a452-fd81-4a54-9a14-0df725988fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:26.671356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:26.672270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:26.673515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 13/24] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:26.681471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:26.816577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba22856-b26e-4aeb-b6df-d164101cf9c1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:26.865292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:26.866360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.867366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.867837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.868819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:26.869317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:26.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7415d-bc45-44a0-845f-d9b97334951f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:26.879630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a9da-fbc2-43eb-99ed-a3a3e09ced58 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.879915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a9da-fbc2-43eb-99ed-a3a3e09ced58 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.880194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a9da-fbc2-43eb-99ed-a3a3e09ced58 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.881570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:26.887731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 12/26] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:26.893467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79a9da-fbc2-43eb-99ed-a3a3e09ced58 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:26.898662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:26.898662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:26.898662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:26.933243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:26.934469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:27.072634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:27.117789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.162709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79a9da-fbc2-43eb-99ed-a3a3e09ced58 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.230054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.230867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.231207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.231484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.232951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.235949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f2625-f0a8-42ff-be64-225e4785b8f1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.245795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 15/28] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:26 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:27.247114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c571-6e3a-456e-b86b-2f52d9ab8261 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.247398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c571-6e3a-456e-b86b-2f52d9ab8261 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.247674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c571-6e3a-456e-b86b-2f52d9ab8261 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.252370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 16/29] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:27.255355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c571-6e3a-456e-b86b-2f52d9ab8261 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.321607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9ddef-d3ca-489b-914c-4c61d34b0cb8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.357061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.357854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.358165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.358437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.369265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.370762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.382296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c571-6e3a-456e-b86b-2f52d9ab8261 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-00c76938-fb9d-4efa-9b83-417e5e36ea55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:33:27.388267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:27.389090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:27.390356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:33:27.390356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:33:27.390356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:33:27.390356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:27.390356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 14/30] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:27.390982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.391321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.391605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.408370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:27.409542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:27.424119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658121c-e425-46b7-9558-d836807847cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.425184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658121c-e425-46b7-9558-d836807847cb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.425518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658121c-e425-46b7-9558-d836807847cb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.426004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658121c-e425-46b7-9558-d836807847cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.427626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658121c-e425-46b7-9558-d836807847cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.429709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658121c-e425-46b7-9558-d836807847cb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.432537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:27.434320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796acd-be4c-4cae-a72e-fa2e8537f804 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.434728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796acd-be4c-4cae-a72e-fa2e8537f804 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.435011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796acd-be4c-4cae-a72e-fa2e8537f804 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.436716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 18/32] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:27.437425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796acd-be4c-4cae-a72e-fa2e8537f804 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.488537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 15/33] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:27.489403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.565300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796acd-be4c-4cae-a72e-fa2e8537f804 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.600657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.601680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.601964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.602268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.603007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:27.603241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f553f-a14b-4513-bea5-3f8fe653dc59 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.603406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.604850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06c30-da07-4d3f-9ae1-78334365d538 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.630107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 19/34] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:27.631524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.631824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.632097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.647778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.649547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.649881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.650197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] PATH_INFO: `/v3/domains/default/users/97db43a40c2a4364b17888ab2b4ef553/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.652762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=97db43a40c2a4364b17888ab2b4ef553, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.653745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:27.654304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.655417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:27.723988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 20/35] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:27.725158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.841257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade3d49-a04d-4deb-a1f6-ca02fe955661 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:27.863248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 16/36] 10.222.0.26 () {58 vars in 1361 bytes} [Thu May 5 13:33:27 2022] PUT /identity/v3/domains/default/users/97db43a40c2a4364b17888ab2b4ef553/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:27.864547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:27.889556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:27.890689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:27.891231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:27.891732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:27.892775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:27.894509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49e1b-e0f4-4c05-b074-5ef829c47ade None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:27.983172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154537c9-7b2e-4ab1-abe7-8e0b2b07bc41 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:28.021745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:28.022535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.023027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.023310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.024044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:28.025729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:28.134046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 17/37] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:33:27 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:28.134988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:28.139032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 21/38] 10.222.0.26 () {60 vars in 1131 bytes} [Thu May 5 13:33:27 2022] POST /identity/v3/roles => generated 225 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:28.251147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c710-0c52-4c67-a08e-645b5603c70a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.251522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c710-0c52-4c67-a08e-645b5603c70a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.251725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c710-0c52-4c67-a08e-645b5603c70a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.254128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 22/39] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:28.263599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679674c9-cee0-400a-9cf3-40ef7a8c282b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.263898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679674c9-cee0-400a-9cf3-40ef7a8c282b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.264170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679674c9-cee0-400a-9cf3-40ef7a8c282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.298341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8094b-af11-48e0-8b21-f8d8bf11a1f2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:28.307274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-679674c9-cee0-400a-9cf3-40ef7a8c282b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:28.308909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-679674c9-cee0-400a-9cf3-40ef7a8c282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:28.357393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:28.358870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.359347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.359811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.360768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:28.362565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:28.385679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 23/40] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:28.387985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b117e7-8545-4cb5-a8ce-a492e30922ba None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.388259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b117e7-8545-4cb5-a8ce-a492e30922ba None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.388677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b117e7-8545-4cb5-a8ce-a492e30922ba None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.389999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 24/41] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:28.395732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.396360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.396893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.422425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:28.424176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:28.439674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 18/42] 10.222.0.26 () {60 vars in 1131 bytes} [Thu May 5 13:33:28 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:28.443866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:28.524756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 25/43] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:28.554832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:28.566041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b819b2-2aff-4ddd-912a-d964ecf8a57f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:28.616811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:28.618004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.618314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.618592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.620417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:28.622083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:28.624721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 19/44] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:28.630197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:28.685220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a6b2-4795-41cd-814e-790b2acb96ad None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:28.721284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:28.722033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.722329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.722606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.723382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:28.725024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121347a-2834-4455-ae86-8847cfcd4f46 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:28.735808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ec7-bc55-4234-8b92-40867dcf0429 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:28.770762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:28.771427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:28.771715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:28.771991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:28.772733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:28.774786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe62d-3087-4fb8-8e76-811bd030ae89 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:28.813161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 26/45] 10.222.0.26 () {60 vars in 1131 bytes} [Thu May 5 13:33:28 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:28.930129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 20/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:33:28 2022] POST /identity/v3/projects => generated 312 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:33:30.375838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227546-63a1-4ebf-9104-0174ff74d48f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:30.376315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227546-63a1-4ebf-9104-0174ff74d48f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:30.376315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227546-63a1-4ebf-9104-0174ff74d48f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:30.377767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 27/47] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:30.383022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:30.383460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:30.383582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:30.401468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:30.402979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:30.465356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 21/48] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:30.489944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96227546-63a1-4ebf-9104-0174ff74d48f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:30.598740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96227546-63a1-4ebf-9104-0174ff74d48f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:30.631886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:30.632633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:30.632915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:30.633189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:30.642894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:30.650971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:30.651855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:30.652616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 28/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:30.657845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:30.751919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25809-0882-4f7b-a9b0-dc4bafa3d25c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:30.783533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:30.784198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:30.784480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:30.784755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:30.785505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:30.785810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:30.787229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:30.795574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 22/50] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:30.800969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:30.900350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c24c-7fc7-46ad-94c8-a4458b6e173d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:30.933491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:30.934388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:30.934669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:30.934942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:30.936128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:30.937574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:30.939389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 29/51] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:30 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:30.945342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:31.044470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497887e-c191-4384-8726-7e11cb38c209 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:31.077619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:31.078443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.078724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.078997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.080160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:31.081656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806a041-a4a9-4a7e-a882-ae14511746d0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:31.083304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 23/52] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:31.089047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:31.184787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806ffb-ec3b-4f64-8f55-9fea861b6ef6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:31.185037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9862-2fa7-4ce1-9ca9-381c77f1d087 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.185358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9862-2fa7-4ce1-9ca9-381c77f1d087 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.185639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9862-2fa7-4ce1-9ca9-381c77f1d087 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.187043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 24/53] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:31.191928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.192219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.192501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.209368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:31.210566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:31.217771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:31.218448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.218731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.219011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.219847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.domain.id=default, user.id=97db43a40c2a4364b17888ab2b4ef553) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:31.220157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:31.221600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:31.227500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 30/54] 10.222.0.26 () {56 vars in 1322 bytes} [Thu May 5 13:33:31 2022] GET /identity/v3/role_assignments?user.id=97db43a40c2a4364b17888ab2b4ef553&scope.domain.id=default&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:31.280408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 25/55] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:31.305016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:31.406529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457614a-4201-448b-b8ec-61912e016c9a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:31.439584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:31.440304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.440582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.440857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.442047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:31.443500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd46c8-b49e-47e7-99fe-0e3532c1fdd1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:31.445902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 31/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:31.451416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:31.546545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0390-c8c9-4f47-9c66-3aef616376d6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:31.578254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:31.578896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:31.579177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:31.579450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:31.580156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:31.581591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b8f6-dbac-4e50-a178-dcf3e47e94bf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:31.674492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 26/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu May 5 13:33:31 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:33.888581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6b2e-2d87-41cd-ab38-b7ba4be84bab None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:33.889108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6b2e-2d87-41cd-ab38-b7ba4be84bab None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:33.889108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6b2e-2d87-41cd-ab38-b7ba4be84bab None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:33.890532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 32/58] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:33.895684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:33.896081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:33.896238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:33.912543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:33.914284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:33.976810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 27/59] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:34.000680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6b2e-2d87-41cd-ab38-b7ba4be84bab None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:34.097019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6b2e-2d87-41cd-ab38-b7ba4be84bab None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:34.129547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:34.130354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:34.130636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:34.130909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:34.132074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:34.133521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5313a64-95b5-4099-999c-86cf0b1c8e5f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:34.135160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 33/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:34.140575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:34.233907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d020e-f913-4ba1-9754-bac65e961fe2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:34.264612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:34.265247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:34.265529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:34.265803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:34.266540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:34.267981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299d22-3c4d-4e42-9bab-745cf5dd2327 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:34.372363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 28/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:33:34 2022] POST /identity/v3/users => generated 275 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:37.549442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef43e5-5d7a-4f77-8680-3f4ff3659c06 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:37.550311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef43e5-5d7a-4f77-8680-3f4ff3659c06 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:37.550725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef43e5-5d7a-4f77-8680-3f4ff3659c06 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:37.552516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 34/62] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:37.557456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:37.558219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:37.558717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:37.583038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:37.584451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:37.671367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 29/63] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:37.706340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef43e5-5d7a-4f77-8680-3f4ff3659c06 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:37.835908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef43e5-5d7a-4f77-8680-3f4ff3659c06 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:37.870279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:37.871083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:37.871369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:37.871646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:37.882781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a6a4def9-760b-489c-893b-d8caeac7357e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:37.890391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:37.891324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:37.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 35/64] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:37.897468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:37.994804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cf95-a664-4a32-8b5c-841a252e0a97 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:37.995139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cf95-a664-4a32-8b5c-841a252e0a97 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:37.995376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cf95-a664-4a32-8b5c-841a252e0a97 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:37.997083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 36/65] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:38.002754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.003039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.003323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.021739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:38.023558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:38.088863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff482-3fb6-4243-a2fd-db35227a931c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.124922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 37/66] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:38.147260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.148415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.148524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.148752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.149027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.149797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:38.150129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.151541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.172996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 30/67] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:38.178676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.270166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825cc7-ae16-4925-8409-6baba72dc092 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.303656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.304680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4e20e-735c-49f3-81f6-19836927ac11 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.305054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.305337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.305614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.317253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-1c24ed71-0e83-4212-98f4-bd4c68bd4b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:38.325371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:38.326394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:38.327171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 38/68] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:38.328312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08e8-2a10-42d3-b0c3-d0336cd8fef4 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.328312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08e8-2a10-42d3-b0c3-d0336cd8fef4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.328567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af08e8-2a10-42d3-b0c3-d0336cd8fef4 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.334115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 39/69] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:38.334115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a950-bfef-481a-af53-9e2148f4298d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.334115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a950-bfef-481a-af53-9e2148f4298d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.334115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9a950-bfef-481a-af53-9e2148f4298d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.334115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 40/70] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:38.334684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9a950-bfef-481a-af53-9e2148f4298d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.348991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.349791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.350102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.350379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.366360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.367828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaac96-92a3-455e-852f-c816efb3ac6a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.374176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 31/71] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:38.374176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9629-385d-4887-bea4-4a9562bc0778 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.374176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9629-385d-4887-bea4-4a9562bc0778 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.374176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9629-385d-4887-bea4-4a9562bc0778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.387503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2fdf9629-385d-4887-bea4-4a9562bc0778 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:38.388701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2fdf9629-385d-4887-bea4-4a9562bc0778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:38.438735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9a950-bfef-481a-af53-9e2148f4298d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.456040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 32/72] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:38.457287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.457586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.457868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.477614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:38.479374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:38.485749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.486457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.487071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.487071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.487850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:38.488162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.489531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.498273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 41/73] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:38.499127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.543770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 33/74] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:38.544621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.611184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab34db-8bdd-40f3-ac42-082e1f00c732 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.642983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.643619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.643897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.644166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.647201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2818b-78fc-4ec3-a617-a6dd6c42eb68 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.679655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.680434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.680712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.680981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.691715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-17087d7d-49ea-4128-a874-f91197c89b84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:38.701418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:38.702350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:38.703147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 34/75] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:38.704180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457962-472c-4b74-a7e6-c9465c59f7d8 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.704180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457962-472c-4b74-a7e6-c9465c59f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.704358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457962-472c-4b74-a7e6-c9465c59f7d8 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.705779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 35/76] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:38.706320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad457962-472c-4b74-a7e6-c9465c59f7d8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.710247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.711749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.801008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad457962-472c-4b74-a7e6-c9465c59f7d8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.804376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 42/77] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:38.805199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.832324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489563-e367-4319-8129-211440a4df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.833179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489563-e367-4319-8129-211440a4df9a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.833456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489563-e367-4319-8129-211440a4df9a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.833727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489563-e367-4319-8129-211440a4df9a None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.834934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489563-e367-4319-8129-211440a4df9a None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.836918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489563-e367-4319-8129-211440a4df9a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.838552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 36/78] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:38.843057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489563-e367-4319-8129-211440a4df9a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:38.898332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252b8-3e21-4428-abe7-1f19e1cba801 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.930478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.931265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.931543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.931810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.931944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489563-e367-4319-8129-211440a4df9a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:38.941336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-f6e727e7-cda8-45fc-bf24-3087db3962cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:38.949949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:38.950902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:38.951702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 43/79] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:38.952329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.952695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.952852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.967636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:38.968122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:38.968292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:38.968571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:38.968842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:38.969289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:38.969579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:38.969882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:38.971312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:38.979687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 37/80] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:38.979687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.031858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 44/81] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:39.032691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.078573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175b16-70a8-4b24-9c39-669fc058d00a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.111984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.112844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.113123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.113396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.114611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.116055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.117792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 38/82] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:38 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.118572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.126715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf199a0-c19b-4748-b05e-9f5fbeb56d77 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.159014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.159599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.159884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.160165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.212118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafee3f0-61ef-40e4-8542-a19235b35bad None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.222593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.224062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.244169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.244826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.245110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.245388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.246160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:39.246469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.247824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.255385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 39/83] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.256167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.321879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:39.322755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.356343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faa43c-b185-4c88-8de1-00f3d74405f1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.392416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.393289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.393579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.393850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.395073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.396525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.398212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 40/85] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.398978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.421590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2ddf-952f-4e05-ba3f-dce3e436ba9e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.462885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.463645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.463929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.464210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.465532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.467035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.468676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 46/86] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.469435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.507610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ddda-c184-4141-9e45-486aa76a7c69 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.540816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.541471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.541821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.542123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.542952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:39.543258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.544710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.552910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 41/87] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=b7a58b4c991b4594847a1560389a3510 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.554348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.580621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c703-0b97-4210-8a85-bbc422d44ef8 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.626613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.627869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.628154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.628431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.629670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.631169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.638401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 47/88] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.638401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.678598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f6ba-4d2e-491c-876b-1b3d708348cc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.730858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.731752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.736382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.736780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.738223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.739719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.742336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 42/89] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:39.746959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.759246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a12ca-1434-4c67-9e6e-b784f28bc629 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.796817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.797505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.797790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.798095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.856634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa19ddf-f99b-4d2a-a132-117b34b1820e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:39.865284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.867841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.895584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:39.896259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:39.896545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:39.896821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:39.897560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:39.899052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:39.967561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 43/90] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:33:39 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:39.968423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:39.984248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 48/91] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:39.985525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:40.102739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae578b6-1e92-4e60-83e4-c99ab41f2aa9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.109159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cb7c3-7fcb-429c-a544-524ab51a53a4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.139900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.140951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.141464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.141969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.143084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=97db43a40c2a4364b17888ab2b4ef553) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:40.143612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.145388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.151625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.152291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.152573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.152847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.154219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/role_assignments?user.id=97db43a40c2a4364b17888ab2b4ef553&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:40.155419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:40.255934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.258028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.291751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2419-1dbf-4a3e-8635-cb675b40f3f1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.328768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.330147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.330803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.331332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] PATH_INFO: `/v3/projects/44236a00e54e4a4381bbb867bba75879` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.332856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=44236a00e54e4a4381bbb867bba75879)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.334605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.337227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 50/93] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:40 2022] GET /identity/v3/projects/44236a00e54e4a4381bbb867bba75879 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:40.343488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:40.367653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 44/94] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:40.374933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:40.461577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427eb98-3570-44ac-80a4-024ebc7e7cb1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.479015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e19fb-b499-4cbe-ad56-972907e1d80f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.498720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.500047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.500476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.500886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.502191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=44236a00e54e4a4381bbb867bba75879, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:40.502841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.505076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.513609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 51/95] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:40 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=44236a00e54e4a4381bbb867bba75879&role.id=b7a58b4c991b4594847a1560389a3510 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:40.518093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.518093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.518093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.518093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.518921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.520462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a528ca2-c4c3-44cd-8969-994df5582de3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.522339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 45/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:40 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:40.529188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:40.651665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc60e-f246-43a0-9929-2eb7013a1256 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:40.690737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:40.691837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:40.692376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:40.692849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:40.694206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:40.694755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:40.696429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabcf81-9a1a-47f8-957a-afea54eb58da None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:40.703021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 52/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:40 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:42.776997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3d4-d345-4309-a2b9-62d7cb3083be None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:42.778052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3d4-d345-4309-a2b9-62d7cb3083be None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:42.778563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e3d4-d345-4309-a2b9-62d7cb3083be None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:42.780150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 46/98] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:42.785551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885c7f-3e02-46e0-8ef5-3c11cb007128 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:42.786410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885c7f-3e02-46e0-8ef5-3c11cb007128 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:42.786886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885c7f-3e02-46e0-8ef5-3c11cb007128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:42.808717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ef885c7f-3e02-46e0-8ef5-3c11cb007128 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:42.810354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ef885c7f-3e02-46e0-8ef5-3c11cb007128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:42.890649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 53/99] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:42.924264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e3d4-d345-4309-a2b9-62d7cb3083be None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.023704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115480-b326-421a-ab79-77e1fb7fe8cd None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.024362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115480-b326-421a-ab79-77e1fb7fe8cd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.024842 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115480-b326-421a-ab79-77e1fb7fe8cd None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.026441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 54/100] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:43.039514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.040073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.040544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.066572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e3d4-d345-4309-a2b9-62d7cb3083be None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.091985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:43.093539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:43.152522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.153325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.153609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.153883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.168389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:43.177229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:43.178164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:43.179539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:43.182232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 47/101] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:43.187651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.207935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 55/102] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:43.245058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.295014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad9d6b-01a0-4a3f-abe4-8b25545e39e6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.339664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.340595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.341027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.341435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.342434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:43.342880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.344422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.359546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 48/103] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:43.365170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.375796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5b40-0aed-4271-aa51-7eb28ce97b65 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.423000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.424174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.424658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.425122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.442955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:43.459975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:43.460960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:43.461758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:43.463932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 56/104] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:43.469939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.480609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce33-f1db-4d8a-8b7c-6b9a9b1a8a55 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.521472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.522475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.522761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.523037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.524258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.525733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.527409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 49/105] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:43.533022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.636020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f7b4-c0ec-4580-b0aa-edf03d689c8c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.646966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3338-7c6d-4536-b0fe-3f0698d65707 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.685257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.690450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.690808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.691101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.692773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.697758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.702856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 50/106] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:43.711140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.718634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.719330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.719619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.719901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.720687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:43.720998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.722476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.753437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 57/107] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:43.761063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:43.874955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dde-656c-462e-bcc7-042f7090ef7d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.891154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f90f-6a0b-4f82-a0dc-44e621975faa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:43.908516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.909421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.909703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.909978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.912079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, user_id=5bef4ce41a6a4937a143e45b440eaa6e, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.914151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c66842-fdba-40dc-9223-57108f544c19 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.924563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:43.925434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.925718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.925992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.927211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:43.928678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0321266-3813-45b2-8e72-ebe72829bc53 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:43.930418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 58/108] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:43.931485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ca42-f84f-4b1f-b383-53361203c66b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.931767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ca42-f84f-4b1f-b383-53361203c66b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ca42-f84f-4b1f-b383-53361203c66b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 59/109] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a24e-b71b-437c-b34a-775c933ac6a7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a24e-b71b-437c-b34a-775c933ac6a7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a24e-b71b-437c-b34a-775c933ac6a7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 60/110] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:43.940218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b952c7-34c1-4791-b9b7-3ea27c5c7df8 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:43.940871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b952c7-34c1-4791-b9b7-3ea27c5c7df8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:43.940871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b952c7-34c1-4791-b9b7-3ea27c5c7df8 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:43.940871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 61/111] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:43.941058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b952c7-34c1-4791-b9b7-3ea27c5c7df8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.002071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 51/112] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:43 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:33:44.002071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407005-7a3f-4fa0-8691-4009c16d8b3c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.002071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407005-7a3f-4fa0-8691-4009c16d8b3c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.002071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407005-7a3f-4fa0-8691-4009c16d8b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.024439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-70407005-7a3f-4fa0-8691-4009c16d8b3c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:44.026584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-70407005-7a3f-4fa0-8691-4009c16d8b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:44.050392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b952c7-34c1-4791-b9b7-3ea27c5c7df8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.105379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.106320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.106661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.106942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.108180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.109661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffeb729-4ca6-44c5-b0e1-fc74c4aaca2e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.111663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 62/113] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:43 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:44.112819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.113101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.113373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.121940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 52/114] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:44.123803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.124357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.124918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.132467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:44.132942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:44.144351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:44.145921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:44.202624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 63/115] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:44.203562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.221328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 53/116] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:44.222737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.345391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf9ed6-7ea6-45c1-89d5-6091b98d4595 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.349786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40599b31-5b22-4c6e-bf80-3df5716fca22 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.380571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.381503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.381811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.382117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/97db43a40c2a4364b17888ab2b4ef553/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.384170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, user_id=97db43a40c2a4364b17888ab2b4ef553, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.385562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.385695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.386394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.386682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.386962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.397501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:44.405177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:44.406079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:44.406917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 54/117] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:44.411963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.468766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 64/118] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:44 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/97db43a40c2a4364b17888ab2b4ef553/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:44.469919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.545047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b99ea-11ab-411d-9f74-b52f33a46fb8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.582733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.583545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.583830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.584161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.585934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.587759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.589480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 55/119] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:44.594360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.613673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382f3d-58c1-41e0-8b42-330b89654bae None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.656102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.656885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.657172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.657446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.670030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c7c13473-5bb0-4e9a-908a-30e54b2917d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:44.678235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:44.679185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:44.680379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 65/120] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:44.681305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a458-f307-474c-810a-f6b0a77f503a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.681305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a458-f307-474c-810a-f6b0a77f503a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.681435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a458-f307-474c-810a-f6b0a77f503a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.683249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 66/121] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:44.684135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a458-f307-474c-810a-f6b0a77f503a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.723633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0042c-be75-41af-8719-de9ea2149430 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.761083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.761750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.762043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.762334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.763082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:44.763385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.764997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.778049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 56/122] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:44.778049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.811791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a458-f307-474c-810a-f6b0a77f503a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.847494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.848151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.848432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.848706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.849419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.851597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.886192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c811-4a37-4de0-841b-5a03aa104b67 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:44.920668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:44.921256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.921538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.921809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.922589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:44.922890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:44.924374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a65d-7267-464c-98e9-065845514fe8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:44.932985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 57/123] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:44.934656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:44.935473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:44.935798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:44.945841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 67/124] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:33:44 2022] POST /identity/v3/projects => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:44.946985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:44.956983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:44.958620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:45.033233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 58/125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:45.034634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.091938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ec815-2870-4354-ab7f-00e73cbe5e27 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.136747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.137689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.138051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.138283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.139610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.141204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.142880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3769df-393a-45c4-a11d-0cb3c10bd8dc None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.147726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 68/126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:44 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:45.147726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.220460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.221279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.221560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.221843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] PATH_INFO: `/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.246248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=a5a80eb3c1824b0a9208099b1ae2e41d)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.247751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.249733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 59/127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:45.250308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.325810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf6f5-3fa3-4782-add6-34f277e52f04 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.374753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.375571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.375851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.376123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.382624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af416b1-b2c3-48aa-bc0d-72fea1cd6ed7 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.387396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:45.395709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:45.396619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:45.397851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 69/128] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:45.402197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.426806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.427791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.429103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.429395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] PATH_INFO: `/v3/projects/44236a00e54e4a4381bbb867bba75879` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.431170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] RBAC: Authorizing `identity:get_project(project_id=44236a00e54e4a4381bbb867bba75879)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.432740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.435197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 60/129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/projects/44236a00e54e4a4381bbb867bba75879 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:45.436195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.581672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abee10-b443-47da-b4ee-72bf48bee42a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.599641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6a1c-e067-446a-968f-94f4c03cdd8e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.649056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.649715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.650000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.650301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.665683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.666497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.666786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.667064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.667818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:45.668120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.669501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.687954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 61/130] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:45.688568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.736558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.738053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.836634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 70/131] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:45.842286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:45.911090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285160-ea29-4ce4-a425-5d35301dd709 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.946292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54d06-e58b-402f-b783-80fb8d08d8ab None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:45.973881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.975868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.976664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.976942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] PATH_INFO: `/v3/projects/44236a00e54e4a4381bbb867bba75879/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.979588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] RBAC: Authorizing `identity:create_grant(project_id=44236a00e54e4a4381bbb867bba75879, user_id=5bef4ce41a6a4937a143e45b440eaa6e, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.981445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:45.982378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:45.982659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:45.982928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:45.984310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.987155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:45.988584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:45.991122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 71/132] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:45.991897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:46.063088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 62/133] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:45 2022] PUT /identity/v3/projects/44236a00e54e4a4381bbb867bba75879/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:46.063953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:46.103808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ce24-1d69-4dad-b12a-451631cda67a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:46.147781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:46.148664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.148947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.149272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.150734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:46.153631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:46.155431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 72/134] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:45 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:46.162650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:46.281913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d18b7-4f0d-4808-a553-891575275145 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:46.305926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b4b02-a479-4f57-8061-ed8013abe7ce None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:46.350435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:46.352015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.352489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.352967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.354004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=a5a80eb3c1824b0a9208099b1ae2e41d) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:46.354697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:46.356387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:46.361694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:46.362598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.362883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.363161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.364139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 73/135] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:46 2022] GET /identity/v3/role_assignments?user.id=a5a80eb3c1824b0a9208099b1ae2e41d&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=610eba57da024f739e9e247c877dbc76 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:46.370045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:46.370045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f63881-6c71-4734-a5aa-21c09d05b743 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:46.370045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 63/136] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:46 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:46.378775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:46.496524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47af06-2767-40cc-8aca-5a4db6e10153 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:46.537656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:46.538633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.538911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.539180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.541807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, user_id=5bef4ce41a6a4937a143e45b440eaa6e, role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:46.543379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:46.604584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0f13-0026-4a55-bca7-568b51402c84 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.605222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0f13-0026-4a55-bca7-568b51402c84 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.605703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0f13-0026-4a55-bca7-568b51402c84 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.607720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 64/137] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:46.613658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.614297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.614773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.635111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:46.636710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:46.637901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 74/138] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:46 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/5bef4ce41a6a4937a143e45b440eaa6e/roles/19dffcd65bd44f938b9378bee2156b2b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:46.737311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 65/139] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:46.780763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:46.896637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ec11-b018-4213-8943-5a97d58bd784 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:46.937783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349cc65-b786-489b-8989-9e902190011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:46.938636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349cc65-b786-489b-8989-9e902190011c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:46.938919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349cc65-b786-489b-8989-9e902190011c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:46.939189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349cc65-b786-489b-8989-9e902190011c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:46.958162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349cc65-b786-489b-8989-9e902190011c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d349cc65-b786-489b-8989-9e902190011c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:46.966333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:46.967252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:46.968022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 75/140] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:46.975092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:47.089637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07def7a6-630c-4892-b22e-461a9d03e171 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:47.135685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:47.136726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.137215 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.137686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.138655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:47.139188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:47.140823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:47.154156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 66/141] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:47.160004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349cc65-b786-489b-8989-9e902190011c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:47.270776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349cc65-b786-489b-8989-9e902190011c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:47.365492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:47.365492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.365492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.365492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.365853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:47.365853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:47.365853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 76/142] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:47 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:47.366099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:47.495453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c0307-e83d-46c9-91f3-7a371285e3ff None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:47.541312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:47.542376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.542883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.543360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.632771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:47.634648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b797-63ef-472d-9cd9-775a70f9bae8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:47.757966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 67/143] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:47.764112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:47.773243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8f3e-dc07-4616-b98b-5169012e6f90 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.773801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8f3e-dc07-4616-b98b-5169012e6f90 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.774306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8f3e-dc07-4616-b98b-5169012e6f90 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.776232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 68/144] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:47.781429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.781952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.782479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.808901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:47.810433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:47.882304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2e0c-03eb-47d4-b8f0-a8ecff12fd32 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:47.921135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:47.923157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:47.924343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:47.924982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:47.928112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:47.930950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:47.934119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 77/145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:47 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:47.943177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:47.951424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 69/146] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:48.055493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:48.106031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa842b7-6646-455f-9905-bd5b95cfbebd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:48.174843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:48.175524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.175807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.176082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.176931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:48.177237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:48.178803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:48.185493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 78/147] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:47 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=b7a58b4c991b4594847a1560389a3510 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:48.282002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88ee4-3b6c-4774-a314-b7c6863cd366 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:48.326982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:48.328185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.328678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.329226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.350835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2da50590-bcf7-4b28-b2f6-903fcef7f95b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:48.359232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:48.360208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:48.361022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:48.363535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 70/148] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:48.370559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:48.512518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056127eb-b711-4dc0-b86d-30faa7ca57f2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:48.537182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d032b2-d702-4b3b-aae7-fb7cd62d28f1 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.537863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d032b2-d702-4b3b-aae7-fb7cd62d28f1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.538367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d032b2-d702-4b3b-aae7-fb7cd62d28f1 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.539972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 71/149] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:48.545071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.545612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.546132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.556789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:48.558795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.559084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.559363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.560420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:48.560732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:48.562137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:48.575142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:48.576329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:48.577444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 79/150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:48.583066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:48.691635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 72/151] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:48.720453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:48.777820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac926c-1ce4-4757-9666-5a87431dcc40 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:48.824053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e733e-3e13-4aa2-9a76-2ca3525bdf80 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:48.859971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:48.860758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.861032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.861297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] PATH_INFO: `/v3/users/97db43a40c2a4364b17888ab2b4ef553` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.862456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:48.863522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:48.863799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:48.864065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:48.865217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] RBAC: Authorizing `identity:get_user(user_id=97db43a40c2a4364b17888ab2b4ef553)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:48.867302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:48.869095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 80/152] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:48 2022] GET /identity/v3/users/97db43a40c2a4364b17888ab2b4ef553 => generated 247 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:48.869596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:48.871041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:48.872654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 73/153] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:48.875608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:48.880230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.064747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae505-7617-4840-821e-fc44bfe7ea44 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.070644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7591b6-efa5-45a4-86a8-65a115fc1cab None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.141425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.142031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.142316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.142590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.143301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:49.144735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712743a0-f625-4e2e-9daa-04983c4136ab None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:49.147898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.148547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.148819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.149084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.224404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:49.226518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:49.263586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 74/154] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:33:48 2022] POST /identity/v3/users => generated 283 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:49.265703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15b46-b0c3-4b66-a028-fee7ceab4407 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.266345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15b46-b0c3-4b66-a028-fee7ceab4407 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.266847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15b46-b0c3-4b66-a028-fee7ceab4407 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.268516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 75/155] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:49.284661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714c3-a040-4c10-9a1a-4c893746e62f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.285295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714c3-a040-4c10-9a1a-4c893746e62f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.285834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714c3-a040-4c10-9a1a-4c893746e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.316251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d68714c3-a040-4c10-9a1a-4c893746e62f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:49.317815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d68714c3-a040-4c10-9a1a-4c893746e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:49.329763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 81/156] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:49.335774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.416594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 76/157] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:49.422798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b431-5bde-450a-9f47-b37b09dbe878 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.423366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b431-5bde-450a-9f47-b37b09dbe878 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.423858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b431-5bde-450a-9f47-b37b09dbe878 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.425508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 77/158] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:49.431642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.432208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.432737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.439642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5117-e031-47da-bcd4-56eb3cd91ac2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.463781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:49.465547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:49.477311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.478226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.478503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.478773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.480006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:49.481462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:49.483235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 82/159] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:49.489064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.547562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:49.548946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.596056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85f329-e739-46dc-b163-01ab607d45c0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.639080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.640018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.640302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.640569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.654126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:49.661757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:49.662764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:49.664638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 83/161] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:49.665389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.674151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9339240-0bc8-48b5-83b5-479b0b4144bb None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.721536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.722249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.722524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.722791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.723613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=97db43a40c2a4364b17888ab2b4ef553) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:49.723915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:49.725882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:49.733332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 79/162] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/role_assignments?user.id=97db43a40c2a4364b17888ab2b4ef553&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:49.733957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.802759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b12e-12a8-4489-8225-41bff75f29bd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.842417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.843328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.843675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.844011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.866752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:49.877527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:49.878493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:49.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:49.880709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 84/163] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:49.882131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07200f28-7612-4815-a6a9-23fbad60e618 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:49.886723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:49.938894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:49.939517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:49.939800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:49.940073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:49.940856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:49.941158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:49.942689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:49.963038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 80/164] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:49.976626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.012679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ad59-7167-4904-820d-55701dbcc917 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.061804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.062530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.062871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.063150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.063920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:50.064223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.065629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0629d-1a3f-4867-8777-57d3095080cb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.076097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 85/165] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:50.077439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557937cd-daee-4396-afce-ee0aad387f4a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.077700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557937cd-daee-4396-afce-ee0aad387f4a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.077977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557937cd-daee-4396-afce-ee0aad387f4a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.079378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 86/166] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:50.086005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.086349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.086595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.107208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:50.108650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:50.153267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d99b77-5af3-4b5e-8c92-f606761bb57b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.200531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.201778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.202318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.202796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.204244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.206051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 87/167] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:50.206493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.207541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.210927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 81/168] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:49 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:50.219522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.315748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2dda-1f98-47a0-9c6d-91868d7d9977 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.349665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.351451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.351732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.351999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] PATH_INFO: `/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.353358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] RBAC: Authorizing `identity:get_user(user_id=a5a80eb3c1824b0a9208099b1ae2e41d)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.355119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.356944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 88/169] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:50.358008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.404163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb1c6e-2904-4519-921f-b354d34ac754 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.469002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4b794-55c5-4986-ba23-48959e3eb97e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.481884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.482596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.482878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.483152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.505437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.506274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.507078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.507357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.534952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:50.543502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:50.544402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 89/170] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:50.545626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.563776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.565425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.664230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:33:50.665302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.779986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f24cc-20d2-4e6a-91ef-b8e56ea52df2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.815874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.816535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.816811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.817079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.817986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:50.818314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.820403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.829309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 83/172] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:50.829958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.848128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea555d1-7387-468e-ae5c-2e427854b596 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.930148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.931020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.931301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.931573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:50.932780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:50.941739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3a7d-c07a-41c6-b0bb-41b0e3118352 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:50.942329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:50.944966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 90/173] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:50.945752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:50.997299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:50.998181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:50.998461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:50.998733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] PATH_INFO: `/v3/projects/44236a00e54e4a4381bbb867bba75879` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.000443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=44236a00e54e4a4381bbb867bba75879)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.001910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.004171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 84/174] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/projects/44236a00e54e4a4381bbb867bba75879 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:51.004943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:51.079086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa2be-7770-4217-93b7-6b6c0a102f5e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:51.146845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214816-2642-4134-9af1-2a23ed239bf4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:51.171353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:51.172278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:51.172564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:51.172832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] PATH_INFO: `/v3/users/5bef4ce41a6a4937a143e45b440eaa6e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.178613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] RBAC: Authorizing `identity:get_user(user_id=5bef4ce41a6a4937a143e45b440eaa6e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.180646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.182444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 91/175] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:50 2022] GET /identity/v3/users/5bef4ce41a6a4937a143e45b440eaa6e => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:51.183103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:51.183601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:51.184713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:51.185206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:51.185666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/a5a80eb3c1824b0a9208099b1ae2e41d/roles/610eba57da024f739e9e247c877dbc76` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.188164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, user_id=a5a80eb3c1824b0a9208099b1ae2e41d, role_id=610eba57da024f739e9e247c877dbc76)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.189793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.278235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 85/176] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:51 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/users/a5a80eb3c1824b0a9208099b1ae2e41d/roles/610eba57da024f739e9e247c877dbc76 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:51.279082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:51.309387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb18de-cf54-479e-bbfc-e47fdeecbd47 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:51.358676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:51.361119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:51.361399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:51.361674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.362567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=44236a00e54e4a4381bbb867bba75879, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:51.362876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.367624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.385686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 92/177] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:51 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=44236a00e54e4a4381bbb867bba75879&role.id=b7a58b4c991b4594847a1560389a3510 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:51.454965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfcc0-ff44-4ae5-a777-8b2054476068 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:51.497745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:51.498464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:51.498744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:51.499019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.594220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.595724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.706156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 86/178] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:51.711656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:51.821876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206ee1-f3bd-4703-91e2-185afcd50a20 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:51.856195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:51.857102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:51.857374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:51.857640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:51.858904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:51.860347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341290-884a-47a3-94b3-de2622482ae3 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:51.862275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 93/179] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:51 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:51.868526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:51.973185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a207-418c-4da5-81c2-707543029c89 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:52.010999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:52.011655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.011928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.012196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.013117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=5bef4ce41a6a4937a143e45b440eaa6e) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:52.013418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:52.015001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfce67-5703-4169-bce1-5707de1917ac None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:52.023938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 87/180] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:51 2022] GET /identity/v3/role_assignments?user.id=5bef4ce41a6a4937a143e45b440eaa6e&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:52.640547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de035f-89d1-4e8b-acf9-2a68ad61b409 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.641336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de035f-89d1-4e8b-acf9-2a68ad61b409 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.641336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de035f-89d1-4e8b-acf9-2a68ad61b409 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.642624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 94/181] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:52.651838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca136eb-2cff-41ca-8116-8361015860e2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.651838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca136eb-2cff-41ca-8116-8361015860e2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.651838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca136eb-2cff-41ca-8116-8361015860e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.669764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1ca136eb-2cff-41ca-8116-8361015860e2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:52.671195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1ca136eb-2cff-41ca-8116-8361015860e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:52.745822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 88/182] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:52.769057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de035f-89d1-4e8b-acf9-2a68ad61b409 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:52.797620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210b64-b48c-41a9-8770-8ac9bdea4a45 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.797917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210b64-b48c-41a9-8770-8ac9bdea4a45 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.798208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210b64-b48c-41a9-8770-8ac9bdea4a45 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.799587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 89/183] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:52.807667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72ae4-d638-4448-9953-12a407ae0947 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.808027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72ae4-d638-4448-9953-12a407ae0947 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.808222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72ae4-d638-4448-9953-12a407ae0947 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.809600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 90/184] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:52.810572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a60bf-eb79-4efd-a978-6222e5cecad6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.811127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a60bf-eb79-4efd-a978-6222e5cecad6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.811614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a60bf-eb79-4efd-a978-6222e5cecad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.828128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-460a60bf-eb79-4efd-a978-6222e5cecad6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:52.829564 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-460a60bf-eb79-4efd-a978-6222e5cecad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:52.876373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de035f-89d1-4e8b-acf9-2a68ad61b409 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:52.893393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:52.894456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.894743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.895014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.915770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:52.916986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:52.917367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:52.917535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:52.917708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:52.918705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:52.930621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:52.938130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:52.939052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:52.939874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 95/186] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:52.940533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:52.994110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 92/187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:52.994110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.041868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aee65-7b9a-4eee-9658-e471f20f329d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.073967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.074792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.075074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.075349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.085591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:53.094122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:53.095004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:53.095823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:53.096426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4ba-795d-450d-b847-2caed583bc7d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.099988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 96/188] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:33:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:53.100990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.140500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.141776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.142229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.142676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.143607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:53.144046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.145550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.156190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 93/189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:53.158358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.200414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3799-6ae4-476e-96dc-7c88b415864b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.232449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.233236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.233522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.233797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.238276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.240091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.241940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 97/190] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:53.244033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.263828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0520b9-7849-4c8e-b28d-7b6e14caaf11 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.298583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.299242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.299519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.299820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.300559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:53.300861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.302255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.310438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 94/191] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:53.310438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.348956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695423e-acb4-442b-9f10-893df22a978e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.385807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.386942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.387232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.387503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.401117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.402540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.404393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 98/192] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:53.404986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.410856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c98f1-3bc4-4c07-bb27-2f6cb00d2f58 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.445112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.445805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.446110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.446383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.447085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.448525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.501523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4767-1b6d-4c54-9bfd-7937aeba9a4d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.534165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.535024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.535393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.535668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.536878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.538322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.539924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 99/193] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:53.540674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.560920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 95/194] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:33:53 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:53.567139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.648872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5131cc-0128-4bcf-860b-1a979d3e8003 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.679001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb880b-1f90-42c5-865e-07185268f665 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:53.686186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.687000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.687481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.687857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.718047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:53.719036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:53.719503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:53.719946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:53.762716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.764217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.795373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:53.797131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:53.890805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:53.896219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:53.926839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 96/196] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:53.932738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.020600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b5dc8-f7b4-4043-98e1-e70aaa2028b9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.060605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e7664-95d7-492f-8054-64f72984eeee None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.061564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.062613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.063680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.063957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.065214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.066682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.069405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 101/197] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:54.074874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.128929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.129795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.130094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.130362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.138896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.140358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.142122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 97/198] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:53 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:54.148261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.196977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ba3b8-1a56-4adc-aa56-930fd09e3fbf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.232439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.233410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.233835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.234297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.235300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=637632e9e110457084bad65237c086be, user.id=1215e94c8aa94b9ebf72a24a5789b963) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:54.235753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.237397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4260-f181-44a7-8878-2abf9f5b4c66 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.243334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 102/199] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/role_assignments?user.id=1215e94c8aa94b9ebf72a24a5789b963&scope.project.id=637632e9e110457084bad65237c086be&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:54.244763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e297c-d31e-456d-92f8-e94ae41ee1f1 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.245221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e297c-d31e-456d-92f8-e94ae41ee1f1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.245672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e297c-d31e-456d-92f8-e94ae41ee1f1 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.247083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 103/200] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:54.263793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.264316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.264805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.292002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:54.294834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:54.348456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2cd4-b32e-435f-8a30-a11e23795525 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.385801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 104/201] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:54.412647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.414335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.414825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.415335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.416381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=637632e9e110457084bad65237c086be, user.id=1215e94c8aa94b9ebf72a24a5789b963) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:54.416938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.418682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.426881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 98/202] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/role_assignments?user.id=1215e94c8aa94b9ebf72a24a5789b963&scope.project.id=637632e9e110457084bad65237c086be&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:54.435772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.556361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee984a8-4923-4c2c-aaf7-15b83b7abc08 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.602432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.603626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.604112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.604610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.619512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:54.627474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:54.628376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:54.629192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:54.631625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 105/203] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:33:54.639103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.778933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99bd0-839f-4e95-bec1-79daf071e528 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.813743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.814359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.814635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.814902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.815648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:54.815938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.817293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.826365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 99/204] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:54.831930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:54.934185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad00e-46eb-4cd0-9c92-d14ae4c274b2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:54.969274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:54.970485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:54.970762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:54.971024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] PATH_INFO: `/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:54.972217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] RBAC: Authorizing `identity:get_user(user_id=a5a80eb3c1824b0a9208099b1ae2e41d)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:54.973663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:54.975979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 106/205] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/users/a5a80eb3c1824b0a9208099b1ae2e41d => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:54.981636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:55.083216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de8a0b-0cb7-4909-9225-7c41e3f0fd4d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:55.119090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:55.119749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:55.120084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:55.120357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:55.189688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:55.191236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:55.293119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 100/206] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:55.298608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:55.397722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf0a8-4a8d-4a94-a01b-f6c7ac108845 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:55.432062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:55.432921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:55.433196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:55.433465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:55.434663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:55.436098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0cc10-b2b0-4489-accc-a0c2d5d88b48 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:55.437769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 107/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:55 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:55.444076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:55.556245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af952e-f750-4813-9b37-45483121c1c2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:55.591764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:55.592412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:55.592686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:55.592954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:55.593783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816, user.id=a5a80eb3c1824b0a9208099b1ae2e41d) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:55.594110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:55.595529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316aab5-4592-416e-b96e-bba963818e19 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:55.601985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 101/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:55 2022] GET /identity/v3/role_assignments?user.id=a5a80eb3c1824b0a9208099b1ae2e41d&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=610eba57da024f739e9e247c877dbc76 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:56.364243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf544-5189-4288-8f29-d8184cf4ded6 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.364749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf544-5189-4288-8f29-d8184cf4ded6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.364749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf544-5189-4288-8f29-d8184cf4ded6 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.366135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 108/209] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:56.375889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997702-ac30-42aa-b97c-25b620a587a3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.376302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997702-ac30-42aa-b97c-25b620a587a3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.376479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5997702-ac30-42aa-b97c-25b620a587a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.394587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c5997702-ac30-42aa-b97c-25b620a587a3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:56.395808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c5997702-ac30-42aa-b97c-25b620a587a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:56.467694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 102/210] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:56.493258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bf544-5189-4288-8f29-d8184cf4ded6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:56.591506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dcf97-806f-4e6c-95f1-61e58b27221b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.591847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dcf97-806f-4e6c-95f1-61e58b27221b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.592219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dcf97-806f-4e6c-95f1-61e58b27221b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.594213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 103/211] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:33:56.598581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bf544-5189-4288-8f29-d8184cf4ded6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:56.599110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.599390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.599665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.619953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:56.621754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:56.634278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:56.635077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.635359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.635634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.636814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:56.638359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:56.640009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 109/212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:56.645506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:56.706354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 104/213] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:56.729522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:56.760558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e959-ca3d-425b-bed8-f4e6da052368 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:56.801005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:56.801709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.801992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.802296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.803025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:56.804510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5698d-c795-45c3-b8a7-4916f15890ae None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:56.846747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59f95-c920-40da-99ec-25ff3b8ea373 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:56.892954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:56.893663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.893955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.894234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.904754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:56.912340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:56.914434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:33:56.915524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:56.918372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 105/214] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:56.919668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:56.943277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 110/215] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:33:56 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:33:56.951757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3b35-ffd4-4567-a210-1f68d06e9956 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.952081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3b35-ffd4-4567-a210-1f68d06e9956 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.952361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3b35-ffd4-4567-a210-1f68d06e9956 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.953959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 111/216] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:56.960835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:56.961109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:56.961374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:56.980517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:56.982003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:57.044446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d1e8e-079c-4a65-b3ff-509ca14de0ae None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.059334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 112/217] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:57.081828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.082816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.083262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.083425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.083810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.084798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:57.085239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.086891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.096489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 106/218] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:57.103641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.204469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d20ff-9033-4295-a290-64003aa94e87 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.227402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ca278-90f9-4a4e-b16c-406000bd536f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.249295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.250206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.250484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.250764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.263656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.264138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:57.264554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.265005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.265280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] PATH_INFO: `/v3/users/77b4582fe92d473298c5b8f1caed5eea` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-b6fec86c-8a5f-4d70-ba87-0f4f2ff6e900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:57.274120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:57.275056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:57.275905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 113/219] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:57.276607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fe22-9eff-42ae-9f49-502019b062ce None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.277193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fe22-9eff-42ae-9f49-502019b062ce None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.277193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96fe22-9eff-42ae-9f49-502019b062ce None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.278597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 114/220] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:57.283732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96fe22-9eff-42ae-9f49-502019b062ce None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.286142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] RBAC: Authorizing `identity:get_user(user_id=77b4582fe92d473298c5b8f1caed5eea)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.287795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246813-a472-4b87-aea6-8a4ba4ad8891 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.289986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 107/221] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/users/77b4582fe92d473298c5b8f1caed5eea => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:33:57.298517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.298802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.299077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.322060 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:57.323232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:57.398149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 108/222] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:33:57.399015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.402791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96fe22-9eff-42ae-9f49-502019b062ce None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.437226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.437888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.438197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.438468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.439224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:57.439524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.440971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.450275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 115/223] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:57.450997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.503588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf397c6-21d0-45bb-88b5-b715426cd870 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.539945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.540950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.541233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.541499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.552803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2274c-e1eb-48de-af35-56b4e19bd514 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.587199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.588150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.588428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.589048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.602073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:57.610542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:57.611844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:57.612751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:33:57.614653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:33:57.615501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.615633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 116/224] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:57.615633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.719357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755def4-2338-4b53-9328-9c4b9bf0c72f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.728461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 109/225] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:33:57.729135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.762538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.763690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.764168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.764528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.766298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.767756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.773956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 117/226] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:57.774816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.838096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd22e1-dd28-406b-b3fd-092ce95dc16e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.875135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.875802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.876126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.876402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.877156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:57.877456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.878871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.880534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab720-2cee-4acc-9255-2d9d6da841cb None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:57.888114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 110/227] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:57.889024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.914770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:57.915665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:57.915945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:57.916210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:57.917385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:57.918857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:57.925498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 118/228] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:57.926424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:57.992902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60501960-2cd0-4660-b69e-635355d165b2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.030634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.031539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.031823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.032099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.033291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.034757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.036812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 111/229] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:58.038345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:58.040022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb34e3-cb0d-4e61-b85e-28ed05db9b25 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.075714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.076590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.076866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.077121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.078346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.079851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.081599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 119/230] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:33:57 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:58.082416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:58.161661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f075a8d-4c04-4843-825c-d8dbdca70baf None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.190318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75a5c-5727-46c3-a9f8-b9f961dfde43 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.204473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.205768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.206472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.206891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.208055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=637632e9e110457084bad65237c086be, user.id=77b4582fe92d473298c5b8f1caed5eea) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:33:58.208793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.210932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.218995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 112/231] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:33:58 2022] GET /identity/v3/role_assignments?user.id=77b4582fe92d473298c5b8f1caed5eea&scope.project.id=637632e9e110457084bad65237c086be&role.id=b7a58b4c991b4594847a1560389a3510 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:58.220020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:58.242710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.243788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.244170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.244541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/users/1215e94c8aa94b9ebf72a24a5789b963/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.249663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, user_id=1215e94c8aa94b9ebf72a24a5789b963, role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.251294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.336720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e737-2cda-485c-8f85-8a0032a2758d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.359619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 120/232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:58 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/users/1215e94c8aa94b9ebf72a24a5789b963/roles/19dffcd65bd44f938b9378bee2156b2b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:58.375976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.377171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.377591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.378003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.379468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.381099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3a9c-b643-412b-a222-0a25d7e60fd0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.383211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 113/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:33:58 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:33:58.394072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:58.545254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbf9e-19b8-4cae-b581-a23d346be0b4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:58.588780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:58.589596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:58.589873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:58.590176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/users/1215e94c8aa94b9ebf72a24a5789b963/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:58.592158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, user_id=1215e94c8aa94b9ebf72a24a5789b963, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:33:58.593665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fa759-a842-4bee-bb2d-facbb34a6d1d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:33:58.676124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 121/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:33:58 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/users/1215e94c8aa94b9ebf72a24a5789b963/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:33:59.573957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e32e5-2d3b-44b3-bb2a-1aa6d83472ec None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:59.574454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e32e5-2d3b-44b3-bb2a-1aa6d83472ec None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:59.574454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e32e5-2d3b-44b3-bb2a-1aa6d83472ec None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:59.576093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 114/235] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:59.581477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:59.581874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:59.582060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:59.589260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877952a7-c62b-4a97-b744-0afa5dec6b9b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:59.589619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877952a7-c62b-4a97-b744-0afa5dec6b9b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:59.589898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877952a7-c62b-4a97-b744-0afa5dec6b9b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:59.591515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 115/236] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:33:59.603189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:59.603468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:59.603742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:59.617530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:59.618761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:59.626609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:33:59.627767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:33:59.724535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 116/237] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:59.742118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 122/238] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:33:59.760517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:59.780974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:59.883883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1055be-50e0-4322-99f9-9a91411766e0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:33:59.920458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:33:59.921264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:33:59.921541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:33:59.921810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:33:59.932777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:33:59.940385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:33:59.941284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:33:59.942129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 117/239] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:33:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:33:59.950928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:33:59.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c342-ecd3-46dc-b5d3-d2fdbdf633f6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.010215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.011030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.011293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.011562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.013091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.014841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.016619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 123/240] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:00.022922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:00.126233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f85cc-c106-4481-b938-61fa25b86d2d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.162065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.163246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.163523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.163837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.164733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.166199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.187237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c7281-4103-483c-9200-f9f96db5a408 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.221855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.222578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.222824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.223104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.223853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:00.224155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.226080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.234697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 118/241] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:33:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:00.239755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:00.256215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 124/242] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:00 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:00.366408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c31fd3-10c6-4004-b317-3151e3f84f5a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.408065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23872f-a934-4910-9687-32630892f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.408943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23872f-a934-4910-9687-32630892f74c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.409225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23872f-a934-4910-9687-32630892f74c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.409497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23872f-a934-4910-9687-32630892f74c None admin] PATH_INFO: `/v3/users/5ccf7c31759b4166b6a318c9eeae3606` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.436973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23872f-a934-4910-9687-32630892f74c None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf7c31759b4166b6a318c9eeae3606)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.438408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23872f-a934-4910-9687-32630892f74c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.440469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 119/243] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:00 2022] GET /identity/v3/users/5ccf7c31759b4166b6a318c9eeae3606 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:00.446376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:00.569562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07846e61-aa40-4d67-ade4-62bdc1be0b37 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.613639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.614419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.614606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.614885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.701426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.702858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.816098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:00.822582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23872f-a934-4910-9687-32630892f74c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:00.926487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23872f-a934-4910-9687-32630892f74c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:00.964319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:00.965107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:00.965379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:00.965652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:00.967024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:00.968468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f3d21-3ff1-4232-886a-e563885691bf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:00.970492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 120/245] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:00 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:00.976967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.015802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460fcbd-858f-4bac-8f22-ad55a96d6cdf None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.016136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460fcbd-858f-4bac-8f22-ad55a96d6cdf None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.016350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460fcbd-858f-4bac-8f22-ad55a96d6cdf None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.017742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 121/246] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:01.023209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.023489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.023763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.050264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:01.051468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:01.097804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567a79-ea34-43cb-b585-f87b88f6fbef None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.141686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.142188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 122/247] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:01.142445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.142676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.142944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.143837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, scope.project.id=637632e9e110457084bad65237c086be, user.id=5ccf7c31759b4166b6a318c9eeae3606) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:01.144142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:01.145602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a76e1-f4b6-42c3-a8ca-fe59633aeec6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:01.156123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 126/248] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:00 2022] GET /identity/v3/role_assignments?user.id=5ccf7c31759b4166b6a318c9eeae3606&scope.project.id=637632e9e110457084bad65237c086be&role.id=610eba57da024f739e9e247c877dbc76 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:01.171572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.173457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d344f6-239c-4bbb-ba8b-67bf3889e55f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.173751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d344f6-239c-4bbb-ba8b-67bf3889e55f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.174059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d344f6-239c-4bbb-ba8b-67bf3889e55f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.178056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 127/249] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:01.180665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.180954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.181232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.200008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:01.200693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:01.278606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 128/250] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:01.295603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5add0-3709-43c0-81e6-eb28f27ecc72 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.302943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.332679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.333849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.334900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.335380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.347067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:01.355742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:01.356695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:01.357517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:01.360574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 123/251] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:01.365913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.411328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc90bb2-da34-40a7-a13e-58639c06938a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.448690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.449189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.449477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.449750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.464278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:01.475583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:01.476544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:01.477346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 129/252] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:01.485443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.497112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d58f9-dd64-4212-a14f-9d6eca92b089 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.567299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.568372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.569425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.569888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.570876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:01.571384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:01.572969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:01.587950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 124/253] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:01.593146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.596894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd585a4-c5a6-4dfb-aaf9-79857374cdbc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.636044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.636776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.637000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.637275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.638418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:01.638735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:01.640276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:01.650030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 130/254] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:01.655915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.768859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f064-3a15-4445-8c8a-af1a39ba9acb None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.795984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ea82-3e7e-4ff4-84c9-59779fe353ed None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.806216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.807094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.807377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.807651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.812229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:01.812229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec136-deec-4605-9c2d-303c2d6e6baa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:01.812530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 131/255] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:01.813645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110646-b953-45be-a8cd-785c62ecda1d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.813928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110646-b953-45be-a8cd-785c62ecda1d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.814228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110646-b953-45be-a8cd-785c62ecda1d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.820462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 132/256] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:01.821188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110646-b953-45be-a8cd-785c62ecda1d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:01.867542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.869230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.869734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.870239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] PATH_INFO: `/v3/users/77b4582fe92d473298c5b8f1caed5eea` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.871716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] RBAC: Authorizing `identity:get_user(user_id=77b4582fe92d473298c5b8f1caed5eea)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:01.873384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9a4d1-d98c-47cb-b958-a62640d1c176 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:01.875248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 125/257] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/users/77b4582fe92d473298c5b8f1caed5eea => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:01.883463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.883973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.884438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:01.909420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:01.910943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:01.927024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110646-b953-45be-a8cd-785c62ecda1d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:01.960851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:01.961510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:01.961793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:01.962093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.029675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.031168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.058564 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 126/258] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:02.059418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.140725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 133/259] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:02.141611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.246499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbfee-ed9f-431c-bf91-4e43e4e8a2aa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.281551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.282380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.282661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.282934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.292153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f6d1-b2d0-44d1-8dbb-16f25951d27a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.293349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:02.301024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:02.301938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:02.302782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 134/260] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:02.304103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.366419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.367605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.368077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.368538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.377882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.379792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.381982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 127/261] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:02.383070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.404177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9def-16b9-48dc-9a6c-9231eb7b4ffc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.438835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.439701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.440039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.440248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.441440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.442937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.445259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 135/262] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:02.446026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.554626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f72f-6218-4e17-8142-01ecaf6e4765 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.570459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349f85-1e6a-4745-9ee4-9904651e0dde None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.589225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.590150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.590433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.590703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/users/77b4582fe92d473298c5b8f1caed5eea/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.592698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, user_id=77b4582fe92d473298c5b8f1caed5eea, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.594194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.624030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.624622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.624906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.625180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.626026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:02.626398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.627773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.637012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 128/263] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:02.637637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.669834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 136/264] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:02 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/users/77b4582fe92d473298c5b8f1caed5eea/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:02.670777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:02.841175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444dc59-a44f-4685-88ca-5bfe401dd41f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.853020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf40cf-f676-4d2d-b7df-302f753d5bfd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:02.910877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.911546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.911755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.912030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.913451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=637632e9e110457084bad65237c086be, user.id=1215e94c8aa94b9ebf72a24a5789b963) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:02.913761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.915308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.921478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:02.922172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 129/265] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/role_assignments?user.id=1215e94c8aa94b9ebf72a24a5789b963&scope.project.id=637632e9e110457084bad65237c086be&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:02.922455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:02.922793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:02.923076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] PATH_INFO: `/v3/users/1215e94c8aa94b9ebf72a24a5789b963` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:02.924293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] RBAC: Authorizing `identity:get_user(user_id=1215e94c8aa94b9ebf72a24a5789b963)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:02.925810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:02.931622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 137/266] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/users/1215e94c8aa94b9ebf72a24a5789b963 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:02.937485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:03.097451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef903e9-ae2b-4871-a6fb-2934bb421be9 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:03.141050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:03.141712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:03.141994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:03.142292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:03.227811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:03.229286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:03.353590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 130/267] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:03.359344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:03.474361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09e40-914f-4ad7-ae7b-a4d1cf203d42 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:03.517582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:03.518408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:03.518694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:03.518971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:03.520188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:03.521651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3714-abc5-4efc-ae5a-b09e44850843 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:03.524265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 138/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:03 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:03.529893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:03.641691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463229b-6f6f-419e-a542-5f77e8f904de None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:03.685216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:03.685876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:03.686186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:03.686515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:03.687359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=637632e9e110457084bad65237c086be, user.id=1215e94c8aa94b9ebf72a24a5789b963) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:03.687722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:03.689168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133844aa-de11-435f-badd-0c8cf5b913ec None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:03.698792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 131/269] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:03 2022] GET /identity/v3/role_assignments?user.id=1215e94c8aa94b9ebf72a24a5789b963&scope.project.id=637632e9e110457084bad65237c086be&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:03.947154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a2e0-6ca1-45e2-951f-2a7c662f084d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:03.947699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a2e0-6ca1-45e2-951f-2a7c662f084d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:03.947699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a2e0-6ca1-45e2-951f-2a7c662f084d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:03.949152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 139/270] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:03.968212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cbd5-ab26-4649-b7f0-071ca16fed72 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:03.968734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cbd5-ab26-4649-b7f0-071ca16fed72 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:03.968734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7cbd5-ab26-4649-b7f0-071ca16fed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:03.988205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-01d7cbd5-ab26-4649-b7f0-071ca16fed72 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:03.989774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-01d7cbd5-ab26-4649-b7f0-071ca16fed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:04.107918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 132/271] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:04.133451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a2e0-6ca1-45e2-951f-2a7c662f084d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.139732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18fda6-40e7-4bdb-883b-efe2e2ea1813 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.140018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18fda6-40e7-4bdb-883b-efe2e2ea1813 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.140289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18fda6-40e7-4bdb-883b-efe2e2ea1813 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.141979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 133/272] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:04.148450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.148733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.149007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.166678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:04.167841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:04.239842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:04.263922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.267380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a2e0-6ca1-45e2-951f-2a7c662f084d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.302188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.303003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.303873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.304190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.314705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:04.323580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:04.324505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:04.325320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 140/274] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:04.330491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.364077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1697-c3af-45a0-9429-a27223cd1ec4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.399002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.399953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.400995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.401277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.402484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:04.403931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99c85-b226-4406-8dbf-f065524116c9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:04.410305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 135/275] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:04.410305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40e8-2e61-45ed-b83a-e11790c22a58 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.410305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40e8-2e61-45ed-b83a-e11790c22a58 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.410305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40e8-2e61-45ed-b83a-e11790c22a58 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.415315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 136/276] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:04.415315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba40e8-2e61-45ed-b83a-e11790c22a58 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.430967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254337e-1930-49bb-8db8-df7b5bee0351 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.466756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.467425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.467707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.467981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.468758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:04.469064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:04.470520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26024f-5c9c-44ca-bc64-eaac80e3abcf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:04.478578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 141/277] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:04.478578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.478578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.478578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.498426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:04.499568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:04.520371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba40e8-2e61-45ed-b83a-e11790c22a58 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.554590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.555249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.555520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.555788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.556480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:04.557901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:04.567559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:04.568648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.659139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 137/279] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:04 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:04.659139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.695991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738136-e9dc-4e02-8352-fd3059b66440 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.743143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.744622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.744924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.745203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] PATH_INFO: `/v3/users/4adc76b2f05748099451e05edbe55540` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.764352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49a22-44fd-44c3-afa0-cf7f543ad00e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.764522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] RBAC: Authorizing `identity:get_user(user_id=4adc76b2f05748099451e05edbe55540)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:04.766283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:04.768948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 143/280] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/users/4adc76b2f05748099451e05edbe55540 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:04.775054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.804698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.805555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.805920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.806248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.820571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:04.830486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:04.831479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:04.832320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:04.836009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 138/281] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:04.842026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:04.912230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f04c1b-998a-41fc-ae6d-80bad04ec244 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.954142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:04.955747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:04.955747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:04.955747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:04.956509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, user.id=4adc76b2f05748099451e05edbe55540, scope.system=all) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:04.956819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:04.957712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c6e8c-9dfa-4349-8d56-118b51ac33ac None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:04.958297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:04.964941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 144/282] 10.222.0.26 () {56 vars in 1308 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/role_assignments?user.id=4adc76b2f05748099451e05edbe55540&scope.system=all&role.id=b7a58b4c991b4594847a1560389a3510 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:04.999620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:05.000312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.000598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.000873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.001647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:05.001952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:05.003505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:05.014092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 139/283] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:05.019980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:05.134522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255fcd5-fdb6-458b-8b30-c4796d5dc037 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:05.171277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:05.172166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.172448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.172721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] PATH_INFO: `/v3/users/5ccf7c31759b4166b6a318c9eeae3606` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.173924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf7c31759b4166b6a318c9eeae3606)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:05.175391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:05.178887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 145/284] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:05 2022] GET /identity/v3/users/5ccf7c31759b4166b6a318c9eeae3606 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:05.183650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:05.319475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1acc9-2d52-42f4-a933-e09f81e2ffde None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:05.366938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:05.368132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.368586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.369029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.370441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:05.372066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2a43-90fd-4a90-a35a-2e1063d83b0e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:05.378126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 140/285] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:05 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:05.380485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:05.537092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1435-aad2-44ce-84a1-1c69da22c84a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:05.571908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:05.572710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.572984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.573249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/users/5ccf7c31759b4166b6a318c9eeae3606/roles/610eba57da024f739e9e247c877dbc76` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.575205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, user_id=5ccf7c31759b4166b6a318c9eeae3606, role_id=610eba57da024f739e9e247c877dbc76)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:05.576638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04610ac-bc06-4110-8e9e-2a4a2675f30a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:05.646689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 146/286] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:05 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/users/5ccf7c31759b4166b6a318c9eeae3606/roles/610eba57da024f739e9e247c877dbc76 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:05.710494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c888e-0807-4099-8525-d88a2f55dd41 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.710814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c888e-0807-4099-8525-d88a2f55dd41 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.711036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c888e-0807-4099-8525-d88a2f55dd41 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.712716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 141/287] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:05.723992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:05.724330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:05.724611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:05.751224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:05.752440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:05.852260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 147/288] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:05.876297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c888e-0807-4099-8525-d88a2f55dd41 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:05.987292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c888e-0807-4099-8525-d88a2f55dd41 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:06.029561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:06.030408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:06.030691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:06.030962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:06.043288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:06.051153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:06.053753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:06.055746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 142/289] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:06.061243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:06.165624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836d0e-63ae-45de-b5c6-94ce36db669f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:06.207524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:06.208284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:06.208560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:06.208831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:06.209709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:06.210076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:06.211527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:06.220992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 148/290] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:06.226797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:06.330216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd0d9f-3a76-4587-bc53-dceaf91ab134 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:06.363726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:06.364512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:06.364784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:06.365326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] PATH_INFO: `/v3/users/77b4582fe92d473298c5b8f1caed5eea` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:06.366586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=77b4582fe92d473298c5b8f1caed5eea)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:06.368002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:06.369941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 143/291] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:06 2022] GET /identity/v3/users/77b4582fe92d473298c5b8f1caed5eea => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:06.375404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:06.473589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f429d-1756-4c34-9a24-d376bca8ed0c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:06.510050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:06.510732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:06.511823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:06.511823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:06.578658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:06.580109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:06.680577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 149/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:06.686003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:06.785687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c52c6-46f3-4495-ab17-cf0a4d04ff68 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:06.825431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:06.826324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:06.826606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:06.826879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:06.828075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:06.829496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8e700-1faa-4435-974f-f1c7bce7d70c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:06.831424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 144/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:06 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:06.836996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:07.073787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3694-3a63-474f-b5d7-43b21ba88a64 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:07.155516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:07.156177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:07.156456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:07.156728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:07.157565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=637632e9e110457084bad65237c086be, user.id=77b4582fe92d473298c5b8f1caed5eea) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:07.157872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:07.159336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4c716-7c22-49b3-8190-aa296df64eaa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:07.170440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 150/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:06 2022] GET /identity/v3/role_assignments?user.id=77b4582fe92d473298c5b8f1caed5eea&scope.project.id=637632e9e110457084bad65237c086be&role.id=b7a58b4c991b4594847a1560389a3510 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:07.716512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6efb5e-94c2-469c-93f4-51dcc3cc8569 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:07.717023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6efb5e-94c2-469c-93f4-51dcc3cc8569 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:07.717023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6efb5e-94c2-469c-93f4-51dcc3cc8569 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:07.720246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f587a-db5c-4fd3-947f-42367338640c None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:07.720531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f587a-db5c-4fd3-947f-42367338640c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:07.720803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f587a-db5c-4fd3-947f-42367338640c None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:07.721267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 145/295] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:07.722788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 151/296] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:07.728228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f921-d576-4569-9999-39517962a5c4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:07.728499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:07.728787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:07.729064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:07.729373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f921-d576-4569-9999-39517962a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:07.729842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f921-d576-4569-9999-39517962a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:07.749895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:07.750885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d240f921-d576-4569-9999-39517962a5c4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:07.751713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:07.752042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d240f921-d576-4569-9999-39517962a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:07.849286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 152/297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:07.852282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 146/298] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:07.875505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240f921-d576-4569-9999-39517962a5c4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:07.876586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:07.975074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240f921-d576-4569-9999-39517962a5c4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:07.978175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198df7-b5b1-4bc4-8a48-1ecd8a501d18 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.009910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.010724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.011007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.011262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.012106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.012897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.013178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.013453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.014659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.016119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842cf5-834a-46bb-b1d4-a3781aa62682 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.017957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 153/299] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.021935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:08.023639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5058d9-83fe-4059-9ace-dc7c40aecb98 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.023932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5058d9-83fe-4059-9ace-dc7c40aecb98 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.024214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5058d9-83fe-4059-9ace-dc7c40aecb98 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.030051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 154/300] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:08.030051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5058d9-83fe-4059-9ace-dc7c40aecb98 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2518db84-2b7b-41f0-a373-b82b59befefb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:08.030318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:08.031162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:08.031994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:08.034402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 147/301] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:08.037149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.037474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.037748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.055564 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:08.056792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:08.124422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 148/302] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:08.125088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.143357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5058d9-83fe-4059-9ace-dc7c40aecb98 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.177374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.178600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.179164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.179164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] PATH_INFO: `/v3/groups` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.179816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.181243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.223998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a82ab-f44d-4841-93eb-b8e7fa5edc35 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.256760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.257358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.257640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.257920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.258696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:08.259001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.260379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968da72-a764-4242-9ca0-09b5a4bb389c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.262811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 155/303] 10.222.0.26 () {60 vars in 1134 bytes} [Thu May 5 13:34:08 2022] POST /identity/v3/groups => generated 229 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:08.263668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.269154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 149/304] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.270332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c714-4354-4ecb-b90d-c12f02703de9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.270623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c714-4354-4ecb-b90d-c12f02703de9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.270899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c714-4354-4ecb-b90d-c12f02703de9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.272367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 150/305] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:08.277062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c714-4354-4ecb-b90d-c12f02703de9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.371162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff1dd8-9e93-4653-acbd-0d26077b0ff9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.386580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c714-4354-4ecb-b90d-c12f02703de9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.408576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.409703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.410172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.410586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.421736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.422643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.422923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.423194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] PATH_INFO: `/v3/users/4dc82b50012543d8ad21c7bd5800c0f3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.423462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7323d69a-0c65-4214-8b09-b284ddeb6ef9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:08.432215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:08.433351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:08.434424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:08.438888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 156/306] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:08.440235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.440528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.440930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.441378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] RBAC: Authorizing `identity:get_user(user_id=4dc82b50012543d8ad21c7bd5800c0f3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.442958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.446051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 151/307] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/users/4dc82b50012543d8ad21c7bd5800c0f3 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.447581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.463344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:08.465547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:08.536306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 157/308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:08.542105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.556898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15825172-25ef-4f50-806b-49812d15e891 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.591396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.592053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.592324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.592595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.593327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:08.593622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.595009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.603388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 152/309] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.604166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.645590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119bdb4-e738-497f-a888-27bf6a0b1b80 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.684300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.684945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.685219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.685483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.686356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, user.id=4dc82b50012543d8ad21c7bd5800c0f3, scope.system=all) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:08.686661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.688083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 158/310] 10.222.0.26 () {56 vars in 1308 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/role_assignments?user.id=4dc82b50012543d8ad21c7bd5800c0f3&scope.system=all&role.id=610eba57da024f739e9e247c877dbc76 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.713408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1616-92f4-48fe-b77f-74c9b8f97370 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.761921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.763052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.763406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.763749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.780456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:08.789819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:08.790970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:08.792090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 153/311] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:08.796830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.812407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31812c1-7fe8-4019-aaa9-51c48219fb14 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.859947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.861264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.861798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.862531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] PATH_INFO: `/v3/users/4adc76b2f05748099451e05edbe55540` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.864249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] RBAC: Authorizing `identity:get_user(user_id=4adc76b2f05748099451e05edbe55540)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.865921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.868731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 159/312] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/users/4adc76b2f05748099451e05edbe55540 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.874760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.913329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd4ed-5254-4626-89e5-5bfc167f1417 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:08.956593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:08.957267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:08.957552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:08.957832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:08.959058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:08.959933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:08.961738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:08.977171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 154/313] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:08.983078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:08.991620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf122c6-1557-4406-918d-86bbb38d688d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:09.036811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:09.037992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:09.038317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:09.038592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] PATH_INFO: `/v3/system/users/4adc76b2f05748099451e05edbe55540/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:09.040683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4adc76b2f05748099451e05edbe55540, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:09.042458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:09.087671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ea1a-db67-4547-ae4b-5d6c9f2993d8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:09.115423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 160/314] 10.222.0.26 () {58 vars in 1334 bytes} [Thu May 5 13:34:08 2022] PUT /identity/v3/system/users/4adc76b2f05748099451e05edbe55540/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:34:09.133691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:09.135106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:09.135593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:09.136067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] PATH_INFO: `/v3/users/5ccf7c31759b4166b6a318c9eeae3606` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:09.137695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] RBAC: Authorizing `identity:get_user(user_id=5ccf7c31759b4166b6a318c9eeae3606)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:09.139584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:09.141980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 155/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:08 2022] GET /identity/v3/users/5ccf7c31759b4166b6a318c9eeae3606 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:09.149140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:09.260221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b07b9f-07de-47de-991b-38f832bd2f6d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:09.297371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:09.298416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:09.298932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:09.299386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:09.368037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:09.369849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:09.469818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:34:09.478952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:09.579127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2466a9-512b-4a39-9903-4ae294c3e96f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:09.612337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:09.613202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:09.613480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:09.613750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:09.614975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:09.617012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab15-06eb-4db2-b6a8-ac3d667219ff None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:09.619048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 156/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:09 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:09.624893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:09.726178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab6658-e67b-448f-bfef-e1ba47d4ee76 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:09.760873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:09.761871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:09.762380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:09.762885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:09.764014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, scope.project.id=637632e9e110457084bad65237c086be, user.id=5ccf7c31759b4166b6a318c9eeae3606) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:09.764519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:09.766251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb0fe-9568-4393-acad-fad225d514d9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:09.778126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 162/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:09 2022] GET /identity/v3/role_assignments?user.id=5ccf7c31759b4166b6a318c9eeae3606&scope.project.id=637632e9e110457084bad65237c086be&role.id=610eba57da024f739e9e247c877dbc76 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:10.541271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca996ba-08de-4f6a-bc63-c70ed3d3ed2b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:10.541757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca996ba-08de-4f6a-bc63-c70ed3d3ed2b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:10.541757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca996ba-08de-4f6a-bc63-c70ed3d3ed2b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:10.543296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 157/319] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:10.548273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:10.548686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:10.548870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:10.565149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:10.566348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:10.636088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:10.658043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca996ba-08de-4f6a-bc63-c70ed3d3ed2b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:10.755865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca996ba-08de-4f6a-bc63-c70ed3d3ed2b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:10.788049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:10.788864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:10.789142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:10.789413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:10.790679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:10.792202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa5d0b-f3b5-4e6c-b64b-8c04b79a75db None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:10.794070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 158/321] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:10.799718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:10.896487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9cfac-9353-499f-846f-354370cd6f6e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:10.933867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:10.934581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:10.934859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:10.935133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] PATH_INFO: `/v3/groups` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:10.936019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:10.938633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:10.994030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2020-8b48-47c2-8f95-dc3d6b7d0f32 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:10.994353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2020-8b48-47c2-8f95-dc3d6b7d0f32 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:10.994625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe2020-8b48-47c2-8f95-dc3d6b7d0f32 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:10.996001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 159/322] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:11.000877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.001160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.001438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.018083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:11.019243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:11.058133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 164/323] 10.222.0.26 () {60 vars in 1134 bytes} [Thu May 5 13:34:10 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:11.134532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 160/324] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:11.157030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.263180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eef43-dd19-41f6-9066-a6f74e44967d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.300369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.301165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.301439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.301705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.312006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-853d24a1-334e-43ed-9efa-e803ab1bc731 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:11.320340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:11.321229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:11.322078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 165/325] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:11.327481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.435267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bfcf-5faf-4ca4-a05e-f468bd4b5ceb None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.468498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d285-2950-4f1f-bb23-b24fe8f08428 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.468839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d285-2950-4f1f-bb23-b24fe8f08428 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.469032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d285-2950-4f1f-bb23-b24fe8f08428 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.472153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 166/326] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:11.475794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.476076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.476350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.477704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.478526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.478923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.479201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.480068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:11.480375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:11.481848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:11.495240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 161/327] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:11.497524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:11.498760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:11.500930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.607405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:11.614733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc4a8-d280-4e2c-b12e-886d88b50738 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.633374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.651540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.653229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.653720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.654233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] PATH_INFO: `/v3/users/4dc82b50012543d8ad21c7bd5800c0f3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.655695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=4dc82b50012543d8ad21c7bd5800c0f3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:11.657334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:11.659243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 162/329] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/users/4dc82b50012543d8ad21c7bd5800c0f3 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:11.665465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.736173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa91-bbe2-45e5-81ae-a79e5c8ceea7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.766144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da5fea-2a9d-4b30-bf33-9388584d2cb2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.775294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.776102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.776383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.776655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.791749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:11.799862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:11.800813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:11.801635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:11.804985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 168/330] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:11.808609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.808609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.808609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.808609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] PATH_INFO: `/v3/system/users/4dc82b50012543d8ad21c7bd5800c0f3/roles/610eba57da024f739e9e247c877dbc76` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.809735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4dc82b50012543d8ad21c7bd5800c0f3, role_id=610eba57da024f739e9e247c877dbc76)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:11.811270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:11.811760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:11.903800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 163/331] 10.222.0.26 () {58 vars in 1334 bytes} [Thu May 5 13:34:11 2022] PUT /identity/v3/system/users/4dc82b50012543d8ad21c7bd5800c0f3/roles/610eba57da024f739e9e247c877dbc76 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:11.919867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8931-9a90-496b-917e-e7b7ad30b6a9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:11.958696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:11.959496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:11.959809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:11.960100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:11.961027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:11.961341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:11.962854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:11.972437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 169/332] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:11.978724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:12.090002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cf8d-4bff-4053-8035-f548da0f99eb None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:12.126946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:12.127903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:12.128183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:12.128503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] PATH_INFO: `/v3/users/4adc76b2f05748099451e05edbe55540` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:12.129822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] RBAC: Authorizing `identity:get_user(user_id=4adc76b2f05748099451e05edbe55540)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:12.131353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c113-5e19-4e74-8da6-1939e2194df0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:12.133314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 164/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:11 2022] GET /identity/v3/users/4adc76b2f05748099451e05edbe55540 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:12.138809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:12.255379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2fcb-ca6b-41ea-b383-937246ea705d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:12.312240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:12.312903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:12.313183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:12.313452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:12.314317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] RBAC: Adding query filter params (role.id=b7a58b4c991b4594847a1560389a3510, user.id=4adc76b2f05748099451e05edbe55540, scope.system=all) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:12.314636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:12.316078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee464a3-5831-4be9-86d5-0025bfb96005 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:12.333405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 170/334] 10.222.0.26 () {56 vars in 1308 bytes} [Thu May 5 13:34:12 2022] GET /identity/v3/role_assignments?user.id=4adc76b2f05748099451e05edbe55540&scope.system=all&role.id=b7a58b4c991b4594847a1560389a3510 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:13.797325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6999f-8b6c-4ebb-9ddf-45c0acffb70e None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:13.797849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6999f-8b6c-4ebb-9ddf-45c0acffb70e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:13.797849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6999f-8b6c-4ebb-9ddf-45c0acffb70e None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:13.799561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 165/335] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:13.813344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:13.814347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:13.814844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:13.843088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:13.844662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:13.921744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:13.971509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6999f-8b6c-4ebb-9ddf-45c0acffb70e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.151743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6999f-8b6c-4ebb-9ddf-45c0acffb70e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:14.193586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:14.194673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.194953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.195223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.211234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d04ee78d-4b12-4982-943e-341820be5933 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:14.218872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:14.219777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:14.220590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:14.225467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 166/337] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:14.226932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.279157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeecdc-02d0-439b-a21e-e3629bb88dea None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.279433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeecdc-02d0-439b-a21e-e3629bb88dea None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.279911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeecdc-02d0-439b-a21e-e3629bb88dea None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.281473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 167/338] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:14.289734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.290297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.290782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.319815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:14.321366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:14.390315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73a300-2c53-4d2d-aefc-24a62b7df8f0 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:14.438270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:14.438511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 168/339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:14.439322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.439759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.440180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.441084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:14.441547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:14.443108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:14.457067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 172/340] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:14.462709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.494165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.609334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1d37-eeca-4a22-bf95-1f1aeb3d6076 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:14.650390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:14.651145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.651426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.651702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.654191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af36c-ed21-402d-a9b1-1cc74e39b968 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:14.671220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:14.683812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:14.684785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:14.685577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:14.690035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 173/341] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:14.700003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.705496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:14.706183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.706467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.706739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.819399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:14.821675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:14.889803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ebdbb-8730-47c3-a55d-35e1159beefe None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:14.972247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:14.973026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:14.973385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:14.973754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:14.974703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:14.975100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:14.976722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:14.990192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 169/342] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:14.991833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:14.997931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 174/343] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:14.999407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.108458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb48a-3621-405a-9942-e2c6cc3ae4a1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:15.148148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:15.149018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.149295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.149555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.150895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:15.152331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:15.156201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 170/344] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:15.163920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.238728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e376-7006-4b57-bcb7-0fd0d88e3cc9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:15.287844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:15.288548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.288782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.289052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.373137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:15.374691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef40c1-d480-4b5f-ad86-1245df27349c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:15.378540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c1541-ca28-4ef7-84dd-cc27f515821f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:15.460410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:15.461276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.461552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.461819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.478320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:15.479816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:15.481625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 175/345] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:34:15.481852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 171/346] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:15 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:15.483004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadc6-d2c1-4466-a5ce-e3af8d454c23 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.483288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadc6-d2c1-4466-a5ce-e3af8d454c23 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.483561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfadc6-d2c1-4466-a5ce-e3af8d454c23 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.484828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 176/347] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:15.487182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.491134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfadc6-d2c1-4466-a5ce-e3af8d454c23 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.650383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9f6c-80b2-4bc9-94c8-fe4867d1ea17 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:15.653179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfadc6-d2c1-4466-a5ce-e3af8d454c23 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:15.692022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:15.692577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:15.693238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.693575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.694128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.694499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.694979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:15.695178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.695282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:15.695736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.696716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208d40-a035-42df-aa0f-66b1613ab884 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:15.697389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:15.699317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337369b-358a-40d5-8613-d03bb2e04a69 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:15.701606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:15 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:15.704082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7aa-cef7-455a-89e4-6f58f8c7392d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.704859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7aa-cef7-455a-89e4-6f58f8c7392d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.705337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7aa-cef7-455a-89e4-6f58f8c7392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.714166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 177/349] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:15 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=b7a58b4c991b4594847a1560389a3510 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:15.715841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0225960-9e32-45f0-ae57-cff2fa1372fb None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.716202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0225960-9e32-45f0-ae57-cff2fa1372fb None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.716550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0225960-9e32-45f0-ae57-cff2fa1372fb None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.718001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 178/350] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:15.718955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0225960-9e32-45f0-ae57-cff2fa1372fb None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.726412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5840f7aa-cef7-455a-89e4-6f58f8c7392d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:15.727928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5840f7aa-cef7-455a-89e4-6f58f8c7392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:15.808656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 173/351] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:15.810977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:15.811264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:15.811539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:15.830923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:15.832975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:15.913057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 174/352] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:15.914687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:15.976108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0225960-9e32-45f0-ae57-cff2fa1372fb None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.021126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.022455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.023007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.023479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.024890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.026607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.028547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 179/353] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:15 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:16.029561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.063466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db280f-b709-4252-bb6d-ac326e404c72 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.137549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.138730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.139239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.139722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.161015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:16.169814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:16.170832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:16.171697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:16.174419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 175/354] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:16.175424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.211111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7bb06-2401-4feb-8d93-5b3408fbe73c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.263497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.264588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.264869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.265139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.279607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:16.289433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:16.290542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:16.291353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:16.293479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:16.295296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.325423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5f4a-a174-4785-b4a7-7bc3d8caa66c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.368558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.369218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.369505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.369780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.371708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:16.372023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.373470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1e78-d266-4d57-8d7b-bc5894fb8e04 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.379631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 176/356] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:16.381926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0366e3-86b2-4f4e-ad61-6e911da820a9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.383034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0366e3-86b2-4f4e-ad61-6e911da820a9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.383533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0366e3-86b2-4f4e-ad61-6e911da820a9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.385545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 177/357] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:16.387127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17e-731a-410b-b26e-e23d24b4cf57 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.387630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17e-731a-410b-b26e-e23d24b4cf57 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.388118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17e-731a-410b-b26e-e23d24b4cf57 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.389659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 178/358] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:16.391766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75def17e-731a-410b-b26e-e23d24b4cf57 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.434296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa748b-bd15-4495-8bc9-e2401b25a7e8 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.488739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.489430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.489714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.489989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.490860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:16.491170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.494666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61703c-af64-4898-a06f-097d238b2288 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.511537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 181/359] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:16.512719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.513010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.513296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.533435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75def17e-731a-410b-b26e-e23d24b4cf57 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.543223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:16.545483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:16.579545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.580185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.580469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.580744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.583637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:16.583637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.583828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50062dd-4ada-440f-86a2-36a303e5aca4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.592450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 179/360] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:16.593716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.594005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.594337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.613643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:16.614887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:16.642279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 182/361] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:16.643311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.706842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 180/362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:16.707928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:16.776585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5e82-ce63-4fea-a8f3-8d9fba2634db None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.812661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.813313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.813591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.813862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.816375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918d5d-3f6c-4754-807a-731e019815d9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:16.856014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:16.856725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:16.856920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:16.857201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:16.883969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.885450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.926340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:16.928334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:16.985004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 183/363] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:16.985878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.034103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 181/364] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:17.035010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.090001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6f9e9-7822-46d0-8652-3c7fdad9bfda None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.134698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.135420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.135698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.135969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.142213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1389-1cc7-493f-97ff-b972ffb5a1c2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.147136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:17.154900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:17.156055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:17.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 184/365] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:17.159006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.180267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.181129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.181413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.181681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.192428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:17.201105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:17.203529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 182/366] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:17.205499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.264207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123299a-3cb1-4322-bf4d-516ab88c045d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.298478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.299340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.299615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.299884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.301111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.302591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.305169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 185/367] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.305962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.312721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67886eeb-2054-494f-9e4a-decc05ad4216 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.346910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.347830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.348109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.348434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.350201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.351652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.353575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 183/368] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.354366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.409293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d0bd5-97b4-43aa-910d-b5b6a2daf5db None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.443672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.444605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.444884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.445156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.445908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:17.446241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.447631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.455995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 186/369] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.456868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.457909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8580b-3264-4bca-87a3-8e5298caf566 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.493080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.493751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.494051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.494334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.495086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:17.495388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.496754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.505482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 184/370] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.507464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.577997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3e8d-d34c-4cb8-bcda-07d8acc747b7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.618303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71081d-e9a1-41ee-80d2-55937f4b6575 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.622485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.623354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.623631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.623902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.625090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.626581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.628208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 187/371] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.629029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.653025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.654267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.654471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.654629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.656100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.658566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.660757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 185/372] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.661478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.737817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98a6f-8391-4947-9dd9-a93eb6459591 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.767197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb8f9-28f1-4111-94f2-fac275395a42 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.773293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.773943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.774267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.774540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.801396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.802298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.802584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.803403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] PATH_INFO: `/v3/users/4dc82b50012543d8ad21c7bd5800c0f3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.804632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] RBAC: Authorizing `identity:get_user(user_id=4dc82b50012543d8ad21c7bd5800c0f3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.806086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.807731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 186/373] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/users/4dc82b50012543d8ad21c7bd5800c0f3 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.808492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.849873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.851446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.910888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d939-fa84-49de-87e2-61db6bbb7a71 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:17.946822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952300af-6021-4731-a544-2883e850149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:17.947626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952300af-6021-4731-a544-2883e850149b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:17.947912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952300af-6021-4731-a544-2883e850149b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:17.948191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952300af-6021-4731-a544-2883e850149b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:17.949513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952300af-6021-4731-a544-2883e850149b None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=637632e9e110457084bad65237c086be) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:17.950121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952300af-6021-4731-a544-2883e850149b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:17.951575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952300af-6021-4731-a544-2883e850149b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:17.952804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 188/374] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:17.953746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:17.957651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 187/375] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=637632e9e110457084bad65237c086be&role.id=b7a58b4c991b4594847a1560389a3510 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:17.958663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952300af-6021-4731-a544-2883e850149b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.067636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906b90-f490-4dab-9388-2cbb195b2c99 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.092225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952300af-6021-4731-a544-2883e850149b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.110416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.111249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.111529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.112104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.112948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=637632e9e110457084bad65237c086be) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:18.113255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:18.115157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:18.123289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 189/376] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=637632e9e110457084bad65237c086be&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:18.124518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.131708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.132386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.132669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.132944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.133800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] RBAC: Adding query filter params (role.id=610eba57da024f739e9e247c877dbc76, user.id=4dc82b50012543d8ad21c7bd5800c0f3, scope.system=all) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:18.134160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:18.135661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:18.148797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 188/377] 10.222.0.26 () {56 vars in 1308 bytes} [Thu May 5 13:34:17 2022] GET /identity/v3/role_assignments?user.id=4dc82b50012543d8ad21c7bd5800c0f3&scope.system=all&role.id=610eba57da024f739e9e247c877dbc76 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:18.242639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fce8-6174-4686-98e9-25e48849c55f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.283661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.284556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.284829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.285105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] PATH_INFO: `/v3/projects/1c80cec912494f1282aea1889f985885` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.286535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=1c80cec912494f1282aea1889f985885)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:18.288066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4661-003a-46a6-8d08-ec9436debcc0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:18.290354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 190/378] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:18 2022] GET /identity/v3/projects/1c80cec912494f1282aea1889f985885 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:18.295988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.444286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0aacd-6183-42a5-9376-c537a1f0559b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.487639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef924b-eeb7-424f-9748-36b185ca6935 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.487639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef924b-eeb7-424f-9748-36b185ca6935 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.487639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef924b-eeb7-424f-9748-36b185ca6935 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.494589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 191/379] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:18.494745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.494745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.494745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.494745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] PATH_INFO: `/v3/groups/561c9c875ae449bead2683fecdb7aede` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.496239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.496239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.496239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.506765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] RBAC: Authorizing `identity:get_group(group_id=561c9c875ae449bead2683fecdb7aede)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:18.506765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:18.506765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 189/380] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:18 2022] GET /identity/v3/groups/561c9c875ae449bead2683fecdb7aede => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:18.512646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.514632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:18.515831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:18.596544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 192/381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:18.624489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.685735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19291a19-05c4-4049-9bb6-b3338959ac3b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.762836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.763431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.763711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.763982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.764082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6abede-3161-4ef5-8ed9-47f6f42ec9a6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:18.764818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] RBAC: Adding query filter params (group.id=561c9c875ae449bead2683fecdb7aede, role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=1c80cec912494f1282aea1889f985885) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:18.765114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:18.766595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:18.776349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 190/382] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:18 2022] GET /identity/v3/role_assignments?group.id=561c9c875ae449bead2683fecdb7aede&scope.project.id=1c80cec912494f1282aea1889f985885&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:18.802197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:18.803086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:18.803369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:18.803640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:18.815182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:18.823861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:18.824848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:18.825672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 193/383] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:18.831367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:18.983858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7abc9-a3ce-49fb-bdcf-9a2acb9ebd82 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:19.027740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:19.028347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.028633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.028910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.029664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:19.029967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:19.031379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:19.041104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 191/384] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:19.046647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:19.155403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70ec2-b009-413a-848a-102172c16c0a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:19.200699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:19.201558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.201837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.202142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.203323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:19.204765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:19.206616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 194/385] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:19 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:19.214544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:19.384188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845d007-048b-4aea-b1cd-aad8570863b5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:19.425200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:19.426076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.426357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.426627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.430845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:19.432336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf898b-f847-47eb-bff0-22e3d5c3857e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:19.434383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 192/386] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:19 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:19.439919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:19.592872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b01a19-321d-4ee6-a8fa-982e85897004 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:19.637559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:19.638401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.638682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.638951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.640934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, group_id=2c2b02291e8d4f8c9e29624afb3e53cd, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:19.642395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:19.667211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77722f4-b7a7-473d-aff3-45857d0a3996 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.672566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77722f4-b7a7-473d-aff3-45857d0a3996 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.672566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77722f4-b7a7-473d-aff3-45857d0a3996 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.672566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 193/387] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:19.674401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.674907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.675394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:19.704165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:19.705694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:19.721175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 195/388] 10.222.0.26 () {58 vars in 1442 bytes} [Thu May 5 13:34:19 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:19.800828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 194/389] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:19.836672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:19.959598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303242b-cb29-4b6b-93cc-853fad78c2a6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:19.996910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:19.997724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:19.998095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:19.998328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:20.012529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:20.020583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:20.030766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:20.031753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 196/390] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:20.032568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:20.172574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00785a8-ddfe-4ff5-b795-2115bdb6088b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:20.217436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:20.218048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:20.218329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:20.218604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:20.219359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:20.219657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:20.221031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:20.232320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 195/391] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:20.237509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:20.369498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981e31-b7d3-4ada-87c2-a6426d7548ab None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:20.413590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b512b-55e4-45af-956f-89c57870544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:20.414849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b512b-55e4-45af-956f-89c57870544d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:20.415361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b512b-55e4-45af-956f-89c57870544d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:20.415829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b512b-55e4-45af-956f-89c57870544d None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:20.417218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b512b-55e4-45af-956f-89c57870544d None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:20.418881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b512b-55e4-45af-956f-89c57870544d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:20.421018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 197/392] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:20 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:20.426130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:20.553836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6176e-f7e5-492d-bc89-183b4c00b2e8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:20.593002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:20.593866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:20.594172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:20.594445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:20.595645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:20.597093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c322d4-3892-496f-82e7-01d0da7d980b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:20.599190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 196/393] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:20 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:20.605073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b512b-55e4-45af-956f-89c57870544d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:20.747932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b512b-55e4-45af-956f-89c57870544d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:20.791287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:20.792156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:20.792436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:20.792703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:20.799967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] RBAC: Authorizing `identity:create_grant(project_id=5c79bb3ec9434362b04bab9b5c3e1816, group_id=2c2b02291e8d4f8c9e29624afb3e53cd, role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:20.802889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d5e2e-5b72-47a2-9a8f-a09cede7acfa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:20.887256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 198/394] 10.222.0.26 () {58 vars in 1442 bytes} [Thu May 5 13:34:20 2022] PUT /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/19dffcd65bd44f938b9378bee2156b2b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:21.266082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7060f-d55b-4e3c-bf37-be02fe64322e None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.266593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7060f-d55b-4e3c-bf37-be02fe64322e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.266593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7060f-d55b-4e3c-bf37-be02fe64322e None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.268076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 197/395] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:21.273468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d7b-f5d3-4bf0-8a6b-852e781e41fd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.273898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d7b-f5d3-4bf0-8a6b-852e781e41fd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.273995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d7b-f5d3-4bf0-8a6b-852e781e41fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.293775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1bfb2d7b-f5d3-4bf0-8a6b-852e781e41fd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:21.295822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1bfb2d7b-f5d3-4bf0-8a6b-852e781e41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:21.375595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 199/396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:21.400083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7060f-d55b-4e3c-bf37-be02fe64322e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:21.422812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c275bc-936a-4077-b844-c434f94da1a9 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.423438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c275bc-936a-4077-b844-c434f94da1a9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.423916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c275bc-936a-4077-b844-c434f94da1a9 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.425743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 200/397] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:21.430901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.431449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.431923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.462666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:21.466523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:21.587004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7060f-d55b-4e3c-bf37-be02fe64322e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:21.589836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 201/398] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:21.630783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:21.631994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.632481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.632955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.643955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:21.652843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:21.653779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:21.654678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:21.656792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:21.667650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 198/399] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:21.672720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:21.810412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122db67-3734-4fa1-8574-e291a22b0f54 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:21.819528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b2222-a22f-4db8-9c65-b32b95f75574 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:21.853099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:21.854666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.855259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.855437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:21.855923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.856096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.856352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.856625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.857563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:21.857867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:21.859333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca2f7-ae85-4e00-bf84-651944088360 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:21.868409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:21.874752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 199/400] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:21.877036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6b91-abf2-4a70-ba4f-f15989c3c2b8 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.877036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6b91-abf2-4a70-ba4f-f15989c3c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.877036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6b91-abf2-4a70-ba4f-f15989c3c2b8 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.877789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 200/401] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:21.878409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:21.879288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:21.880124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:21.883574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 202/402] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:21.883847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:21.884131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:21.884495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:21.885208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:21.907219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:21.908416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:21.991677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:21.991677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.005599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc2a2-4d05-4f5e-a07e-13ba5cb30edd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.042392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.043611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.044220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.044707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.046229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.047950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.049826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 203/404] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:21 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.053617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.126702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140153b-d701-4462-871a-f74f1c27c229 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.166516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.167533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.168015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.168507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.169588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:22.170150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.171720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.180831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 202/405] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.181153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46435-9bf9-4d19-8c5d-e1fd5b091eb6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.182263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.220727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.221878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.222386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.222877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.234891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:22.243517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:22.244453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:22.245274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:22.247688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 204/406] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:22.249227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.291524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187052b3-fdf2-4a84-865f-b072a28b507b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.335214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.336477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.337022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.337527 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.339152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.340863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.342873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 203/407] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.343922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.374545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb036-33bd-4148-abe9-eb9329469da9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.408817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.409592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.409864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.410153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.411329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.413344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.415291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 205/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.416045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.451728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001d089-5c56-49f3-9944-1f6a415ded4a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.487436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.488558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.489041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.489515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.490548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:22.491076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.492729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.502135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 204/409] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.503422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.517825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c421d83-969f-40da-8925-361f9da5e0b2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.552283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.553234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.553508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.556029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, group_id=2c2b02291e8d4f8c9e29624afb3e53cd, role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.557458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.606867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd95c0-efab-411f-a753-54ffa22e4271 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.638596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.639470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.639752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.640027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.640595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 206/410] 10.222.0.26 () {58 vars in 1442 bytes} [Thu May 5 13:34:22 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/19dffcd65bd44f938b9378bee2156b2b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:22.641424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.641570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.643032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b802a3-3936-4ab3-a204-cd95ccce9f76 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.650261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 205/411] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.650261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77700ec9-cc18-4383-98fd-f4e53e3ce043 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.650261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77700ec9-cc18-4383-98fd-f4e53e3ce043 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.650261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77700ec9-cc18-4383-98fd-f4e53e3ce043 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.650261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 206/412] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:22.655668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.656214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.656494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.682291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:22.684512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:22.790040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af12f2-eb47-491e-a039-8947b8b99d4e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.790561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 207/413] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:22.791356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.852742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.853595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.853876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.854168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] PATH_INFO: `/v3/groups/561c9c875ae449bead2683fecdb7aede` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.857043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] RBAC: Authorizing `identity:get_group(group_id=561c9c875ae449bead2683fecdb7aede)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.858558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:22.860541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 207/414] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/groups/561c9c875ae449bead2683fecdb7aede => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:22.861312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:22.923278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c778-4560-4f37-97c3-1d0fc80e64e9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.972199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:22.973026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:22.973303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:22.973572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:22.975652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] RBAC: Authorizing `identity:create_grant(project_id=637632e9e110457084bad65237c086be, group_id=2c2b02291e8d4f8c9e29624afb3e53cd, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:22.976880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08e621-2cc7-4275-971a-6d22e2b72932 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:22.977108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.012458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.013386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.013673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.013945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.024134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:23.031770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:23.033217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:23.034063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:23.037668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 208/415] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:23.038451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.141012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4d0fa-bc4f-44b8-999c-16a78e98af7b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:23.172992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.173962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.174323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.174599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] PATH_INFO: `/v3/projects/1c80cec912494f1282aea1889f985885` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.175852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] RBAC: Authorizing `identity:get_project(project_id=1c80cec912494f1282aea1889f985885)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:23.177366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.184383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 209/416] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/projects/1c80cec912494f1282aea1889f985885 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:23.184383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.246199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 208/417] 10.222.0.26 () {58 vars in 1442 bytes} [Thu May 5 13:34:22 2022] PUT /identity/v3/projects/637632e9e110457084bad65237c086be/groups/2c2b02291e8d4f8c9e29624afb3e53cd/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:23.247344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.311481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4443-c1db-4c24-9e3f-99790aa246fc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:23.347666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.348753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.349290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.350335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.351354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] RBAC: Adding query filter params (name=member) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:23.351880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:23.353456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.363093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 210/418] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:23.370377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.453576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0059c3-afb9-4e5d-83e0-28dcc4cf5478 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:23.490875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0959a3-888f-466a-b76f-ba8cc7a37cdc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:23.499577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.500228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.500518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.500793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] PATH_INFO: `/v3/projects/1c80cec912494f1282aea1889f985885/groups/561c9c875ae449bead2683fecdb7aede/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.502822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c80cec912494f1282aea1889f985885, group_id=561c9c875ae449bead2683fecdb7aede, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:23.504277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087b4ff-3ea4-4f0a-8381-7b0c1cb133f4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.533835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.534621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.534902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.535251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.594881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 209/419] 10.222.0.26 () {58 vars in 1442 bytes} [Thu May 5 13:34:23 2022] PUT /identity/v3/projects/1c80cec912494f1282aea1889f985885/groups/561c9c875ae449bead2683fecdb7aede/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:23.614577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:23.616610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c107d-0468-4c24-ba02-4b65a48f7569 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.726953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 211/420] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:23.728012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7de4f-fe60-4759-8e01-574e8186616a None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.728324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7de4f-fe60-4759-8e01-574e8186616a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.728716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7de4f-fe60-4759-8e01-574e8186616a None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.730356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 210/421] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:23.735572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7de4f-fe60-4759-8e01-574e8186616a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.735970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.736454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.736903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.767049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:23.770376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:23.912854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7de4f-fe60-4759-8e01-574e8186616a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:23.931676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 212/422] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:23.956225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:23.957366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:23.957825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:23.958302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:23.962695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:23.964337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:23.966901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 211/423] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:23.970607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:23.971747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:24.085046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8ea3-7285-44a1-92cf-b98d76555e70 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:24.122662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:24.123850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:24.124185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:24.124463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:24.125665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:24.127600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:24.129613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 212/424] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:24.135139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:24.247019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc652b25-bae4-40ee-8ded-7fb24404c7c7 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:24.248158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633123d4-1b5f-49a2-b3fb-5150b5c2d8c7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:24.295671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:24.296900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:24.297486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:24.298094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:24.299487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:24.306208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:24.306208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:24.306208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:24.306208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:24.306530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:24.306530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:24.314337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 213/425] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:24 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=b7a58b4c991b4594847a1560389a3510 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:24.317582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:24.326905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:24.327914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:24.328765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 213/426] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:24.334415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:24.485277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74625d65-ab02-4193-ab49-624f4a783618 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:24.530507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:24.531578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:24.532063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:24.532538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:24.533522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:24.534055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:24.535687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:24.545804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 214/427] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:24.554136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:24.670180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39aaa6-e5b6-4a87-a6f1-b9f07b8e158e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:24.707423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:24.708449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:24.708997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:24.709492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:24.778880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:24.780733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05699236-6837-44e2-8bdf-d4f355251741 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:24.885339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 214/428] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:24.890929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:24.995431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114f7ec-d9cd-4f88-9f7a-c37181fa7896 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.036020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.037790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.038299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.038736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] PATH_INFO: `/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.040141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] RBAC: Authorizing `identity:get_project(project_id=5c79bb3ec9434362b04bab9b5c3e1816)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:25.041739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:25.044787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 215/429] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:24 2022] GET /identity/v3/projects/5c79bb3ec9434362b04bab9b5c3e1816 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:25.045742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35688-069d-4e9a-9a06-49dbebdec15a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.046264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35688-069d-4e9a-9a06-49dbebdec15a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.046748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35688-069d-4e9a-9a06-49dbebdec15a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.048817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 215/430] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:25.048925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.055156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.055743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.056477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.085469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:25.086725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:25.174571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 216/431] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:25.203698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c8b6-e273-4d14-8a59-e81901c41cce None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.205887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.243091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.244278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.244561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.245003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.246880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:25.248545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:25.251331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 216/432] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:25.257877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.325061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246709-b720-4f9c-94d9-b4712adf11d6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.360512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.361406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.361688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.361959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.371596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0207c2b-8862-48df-9487-5ef383738dc4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.377551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:25.386657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:25.387603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:25.388422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 217/433] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:25.394825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.413040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.414162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.414499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.414927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.415890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:25.416353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:25.418125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:25.426133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 217/434] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=5c79bb3ec9434362b04bab9b5c3e1816&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:25.517956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bbe16-647d-4d4a-a923-d45225baf01b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.559852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.560650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.560834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.561058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.561830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:25.562167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:25.563577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:25.577683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 218/435] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:25.579059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.684202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc1291-6a82-4242-bc5f-b90de5dee8c1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:25.718770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:25.719440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.719721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.719996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.794351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:25.796012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00122-97f6-4e06-8b02-b6f8191f37d5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:25.901583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 218/436] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:25.902911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:25.915020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87847-15ad-45ba-bb25-06b15f8ef040 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.915621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87847-15ad-45ba-bb25-06b15f8ef040 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.916098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87847-15ad-45ba-bb25-06b15f8ef040 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.917984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 219/437] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:25.923557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:25.923838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:25.924107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:25.940849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:25.942071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:26.007033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa8d-239a-4aaa-9dbf-420acb84464a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.008102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 220/438] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:26.031429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.047275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.048149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.048427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.048694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.050156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.051634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.058364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 219/439] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:25 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:26.060116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.135799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3d72-1842-4827-b7df-251bd31f6548 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.168904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.169620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.169900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.170197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.171285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc286-6cb3-4f2c-8960-0842a20f0084 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.181466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:26.189040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:26.189973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 13:34:26.190821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:26.195330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 221/440] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:26.196025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.206365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.207219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.207504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.207782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.208999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.210482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a7337-2195-45ea-a201-0adffccb950a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.212102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 220/441] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:26.215094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c32d4-ad7b-4f02-a5f9-48b132ec8adc None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.215374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c32d4-ad7b-4f02-a5f9-48b132ec8adc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.215643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c32d4-ad7b-4f02-a5f9-48b132ec8adc None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.217106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 221/442] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:26.217689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c32d4-ad7b-4f02-a5f9-48b132ec8adc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.291298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119ac77-16e0-4873-810c-140c70062ac2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.312475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c32d4-ad7b-4f02-a5f9-48b132ec8adc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.323131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.323790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.324071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.324345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.325093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] RBAC: Adding query filter params (name=member) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:26.325393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.326787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6b395-ff09-4f46-ab5a-e46f08e9e028 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.334546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 222/443] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:26.335755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.336071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.336324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.343969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.344616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.344899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.345170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.346042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=637632e9e110457084bad65237c086be) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:26.346358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.347774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.352364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:26.353515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:26.353966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 222/444] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=637632e9e110457084bad65237c086be&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:26.354762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.434167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 223/445] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:26.457096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.473524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593236-f4c8-4aec-8a74-4d4d444301e5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.509048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.509698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.509974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.510270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.561725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05969-f76a-4340-b8de-7e95aacd8371 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.590443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.591903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.597545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.598416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.598700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.598971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.609393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:26.616938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:26.617865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:26.618743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 224/446] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:26.623831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.687791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 223/447] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:26.693201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.721351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f594c-f219-4294-a396-14c972ab6e4a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.753067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.753728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.754008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.754308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.755054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:26.755358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.756769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.764446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 225/448] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:26.769836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.785334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eca80-e85a-43ed-8002-8eecc75256c0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.816840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.817672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.817945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.818259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] PATH_INFO: `/v3/projects/637632e9e110457084bad65237c086be` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.819678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] RBAC: Authorizing `identity:get_project(project_id=637632e9e110457084bad65237c086be)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.821109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.823005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 224/449] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/projects/637632e9e110457084bad65237c086be => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:26.828163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:26.862913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0cb0-18aa-487d-a72a-e3cde21827a0 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.893295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.893920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.894223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.894495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.919964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636abea2-9f3c-4ca4-bba6-fcf2c2816a5b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:26.951773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:26.952541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:26.952818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:26.953089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] PATH_INFO: `/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:26.954276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] RBAC: Authorizing `identity:get_group(group_id=2c2b02291e8d4f8c9e29624afb3e53cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.955704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.957108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:26.957557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 225/450] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/groups/2c2b02291e8d4f8c9e29624afb3e53cd => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:26.958571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:26.963430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:27.051594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 226/451] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:34:27.056136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3a9b2-dd0e-4a85-9ce0-4e85437a5ced None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:27.057117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:27.088932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:27.089566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:27.089845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:27.090149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:27.090980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] RBAC: Adding query filter params (group.id=2c2b02291e8d4f8c9e29624afb3e53cd, role.id=b7a58b4c991b4594847a1560389a3510, scope.project.id=637632e9e110457084bad65237c086be) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:27.091285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:27.098830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:27.105934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 226/452] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:26 2022] GET /identity/v3/role_assignments?group.id=2c2b02291e8d4f8c9e29624afb3e53cd&scope.project.id=637632e9e110457084bad65237c086be&role.id=b7a58b4c991b4594847a1560389a3510 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:27.159846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1f3a3-db47-4a24-bfaa-e60d08bffbe2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:27.195210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:27.196078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:27.196364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:27.196637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] PATH_INFO: `/v3/projects/1c80cec912494f1282aea1889f985885` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:27.197853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c80cec912494f1282aea1889f985885)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:27.199349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:27.201113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 227/453] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:34:27 2022] GET /identity/v3/projects/1c80cec912494f1282aea1889f985885 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:27.207002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:27.307011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994637-346c-40bf-b4a9-9e4b76e6b163 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:27.339606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:27.340447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:27.340726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:27.340997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] PATH_INFO: `/v3/groups/561c9c875ae449bead2683fecdb7aede` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:27.342221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] RBAC: Authorizing `identity:get_group(group_id=561c9c875ae449bead2683fecdb7aede)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:27.343656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e556-af99-400e-be1a-5ff9e3dfd839 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:27.345271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 227/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu May 5 13:34:27 2022] GET /identity/v3/groups/561c9c875ae449bead2683fecdb7aede => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:27.351816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:27.448325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d3206-d810-496c-9301-fc59ab0a95a8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:27.481432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:27.482026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:27.482314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:27.482585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:27.483408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] RBAC: Adding query filter params (group.id=561c9c875ae449bead2683fecdb7aede, role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=1c80cec912494f1282aea1889f985885) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:27.483716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:27.485154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b38a4a-9e05-4a77-a498-7eb7c535f04d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:27.491524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 228/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu May 5 13:34:27 2022] GET /identity/v3/role_assignments?group.id=561c9c875ae449bead2683fecdb7aede&scope.project.id=1c80cec912494f1282aea1889f985885&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:30.089147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c353a-5bcd-4265-8fad-b56a51883a5e None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.089147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c353a-5bcd-4265-8fad-b56a51883a5e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.089147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c353a-5bcd-4265-8fad-b56a51883a5e None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.090420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 228/456] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:30.111734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.112149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.112272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.143451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:30.144642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:30.272244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 229/457] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:30.313616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c353a-5bcd-4265-8fad-b56a51883a5e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:30.463277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c353a-5bcd-4265-8fad-b56a51883a5e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:30.513444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:30.514263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.514542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.514813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.528635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:30.530129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a5a227b0-3861-42c6-b47e-b3fc95ddead9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:30.552845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:30.553776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:30.554682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:30.554682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:30.554682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:30.554682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:30.558353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 229/458] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:30.565718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:30.709317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30e4b-31c2-4d67-8b81-060ac282f901 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.709824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30e4b-31c2-4d67-8b81-060ac282f901 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.710260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30e4b-31c2-4d67-8b81-060ac282f901 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.712010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 230/459] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:30.716780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c850-ed51-4677-b7df-e0aeb6bc3a75 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.717113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c850-ed51-4677-b7df-e0aeb6bc3a75 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.717488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c850-ed51-4677-b7df-e0aeb6bc3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.745158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d31647-86df-4951-adbd-2a9e2bbf686f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:30.747309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0a79c850-ed51-4677-b7df-e0aeb6bc3a75 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:30.748734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0a79c850-ed51-4677-b7df-e0aeb6bc3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:30.784541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:30.785200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.785475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.785740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.786476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:30.787317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:30.788677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:30.815742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 230/460] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:30.821786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:30.882220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 231/461] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:30.885272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ba7d-53f0-4c2a-bd60-8632e194cba7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.885560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ba7d-53f0-4c2a-bd60-8632e194cba7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.885833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ba7d-53f0-4c2a-bd60-8632e194cba7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.891345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 232/462] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:30.892953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:30.893238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:30.893514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:30.910746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:30.912459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:30.962968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4252b7-9f58-44b0-b737-ecb840d16ad5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:30.986939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 233/463] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:30.988165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.026515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.027334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.027619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.027893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.028761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.030838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.101894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0353447-c347-4099-af3f-07188b7f2b5b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.141720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.142588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.142870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.143142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.153160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.154792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.160172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 231/464] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:30 2022] POST /identity/v3/users => generated 246 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:31.161873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-be96758f-f81b-41f3-aeaf-31c5b3ab3d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:31.176147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:31.177138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:31.179312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:31.179312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:31.179312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.179312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:31.179312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 234/465] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:31.179753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dae4-00b8-4ef7-a62a-292f41be276b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.179926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dae4-00b8-4ef7-a62a-292f41be276b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.180198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dae4-00b8-4ef7-a62a-292f41be276b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.186263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 235/466] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:31.187287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8dae4-00b8-4ef7-a62a-292f41be276b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.282651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3930-8109-4d37-901e-a39b00fcbfca None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.318422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8dae4-00b8-4ef7-a62a-292f41be276b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.324522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.325336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.325621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.325896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.341373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.343366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.362387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.363047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.363376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.363649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.364377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-6890688a-7eeb-4777-b167-4ba5ebe4e2dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:31.364498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:31.365377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:31.366692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:31.366692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:31.366692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.366692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:31.366907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.366975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 232/467] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:31.367040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.367288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.367449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.368643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.379420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 236/468] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:31.385067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.391103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:31.392385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:31.473283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 233/469] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:31.473893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.515625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447ae5-b33e-4b47-938d-953556ec5b92 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.549634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.550294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.550573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.550895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.551619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:31.551920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.553342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.565833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 237/470] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:31.567325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.613176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05a503-eb87-40bb-a673-682050cac30c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.651320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.652004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.652285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.652559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.653264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.654770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.673330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c5e7-f792-4122-a060-605e37c50346 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.706745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.707587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.707863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.708132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.718474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.724479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.728392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 234/471] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:31 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:31.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:31.746054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:31.746993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:31.747952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:31.747952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:31.747952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:31.747952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:31.750525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 238/472] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:31.766172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:31.858302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbacb8-c961-47e9-bea4-4f9e383abe2f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.894602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.895460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.895844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.896746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.897577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.899210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce62a-5cba-403f-a7f1-f7632a5185d0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.905795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d01a3-8fe1-40f7-b6ab-78c6c51b9147 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:31.942959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:31.944397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.944676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.944945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.945671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:31.945976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:31.947383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cd42b-bcc8-4098-acaa-91eb0627157c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:31.960280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 239/473] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:31.961569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33729-fcf1-4bf8-8335-b7cc76b718ec None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:31.961857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33729-fcf1-4bf8-8335-b7cc76b718ec None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:31.962171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33729-fcf1-4bf8-8335-b7cc76b718ec None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:31.963525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 240/474] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:31.968832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb33729-fcf1-4bf8-8335-b7cc76b718ec None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:32.023314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 235/475] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:31 2022] POST /identity/v3/users => generated 249 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:32.024653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:32.024979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:32.025539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:32.043823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:32.045403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:32.093479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb33729-fcf1-4bf8-8335-b7cc76b718ec None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:32.123589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 236/476] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:32.135343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:32.136623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:32.137048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:32.137463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:32.138381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:32.140045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:32.148163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:32.234918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 241/477] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:31 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:32.276424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26301-f0a8-42ca-8c73-9ee3fba2b46b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:32.316728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:32.317411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:32.317685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:32.318561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:32.319575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:32.320989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:32.365969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.sql.core [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 13:34:32.365969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 13:34:32.365969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [parameters: {'id': '11c49c4311fd489bbf449ec43f2e9bae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 13:34:32.365969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86653) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application conn.query(q) May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result.read() May 05 13:34:32.383990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return ref.to_dict() May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:34:32.384968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application next(self.gen) May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application yield resource May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application next(self.gen) May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.session.rollback() May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.force_reraise() May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise self.value May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application session.commit() May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 13:34:32.385901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._prepare_impl() May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.session.flush() May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._flush(objects) May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application compat.raise_( May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application flush_context.execute() May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rec.execute(self) May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 13:34:32.387452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:34:32.389024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application conn.query(q) May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result.read() May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:34:32.390927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [parameters: {'id': '11c49c4311fd489bbf449ec43f2e9bae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:32.392673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 13:34:32.396291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:32.399304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 237/478] 10.222.0.26 () {60 vars in 1131 bytes} [Thu May 5 13:34:32 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:32.399466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:32.506298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5b826-8db3-49eb-bf28-b83727ba5bae None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:32.544080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:32.545304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:32.545808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:32.546367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:32.557387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-fbc6dfaf-0061-42a5-bf91-14ad7547ddff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:32.565611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:32.566551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 13:34:32.567351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:32.570330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 242/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:34:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:32.575610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:32.705860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85ad5-8d55-42ae-a09e-edb6f55cfe47 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:32.753907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:32.754621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:32.754902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:32.755183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:32.755993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:32.756299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:32.761946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f049ee-5434-485f-9f8a-46c8f2359d84 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:32.771007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 238/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:33.855524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6107-2ce9-4c09-be32-477896633161 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:33.856080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6107-2ce9-4c09-be32-477896633161 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:33.856080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6107-2ce9-4c09-be32-477896633161 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:33.857891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 243/481] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:33.863080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:33.863470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:33.863634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:33.884658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:33.885826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:33.972633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 239/482] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:34.012909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6107-2ce9-4c09-be32-477896633161 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.156697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6107-2ce9-4c09-be32-477896633161 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:34.210706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:34.211884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.212368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.212828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.230869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:34.238997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:34.240445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:34.241334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:34.250041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 244/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:34.250174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.400451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aa8bb-babc-4433-b622-9605aa3654d4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:34.446695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:34.447297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.447578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.447849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.448611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:34.448913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:34.450321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac28d6-71d1-4505-a55e-cbcd7f2f5abf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:34.466408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 240/484] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:34.471671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.623004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb9f2-a96b-4abe-9bdc-c6fb6d62a4a5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:34.657158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:34.658331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.658809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.659272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.666861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed486e-27e6-4809-9181-e5c128e72158 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.666861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed486e-27e6-4809-9181-e5c128e72158 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.667103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed486e-27e6-4809-9181-e5c128e72158 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.668663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 241/485] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:34.671584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:34.673275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:34.673994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.674324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.674596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e73495c8-cdd4-4536-9782-9a11b0cb74b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:34.693448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:34.694678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:34.695573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:34.695573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:34.695573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:34.695573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:34.695794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:34.695794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:34.698077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 245/486] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:34.699537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246b35-61dd-4029-83ad-76455637234e None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.700026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246b35-61dd-4029-83ad-76455637234e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.700499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246b35-61dd-4029-83ad-76455637234e None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.702203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 246/487] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:34.707272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30886-b15f-4843-b37a-13d838003925 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.707553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30886-b15f-4843-b37a-13d838003925 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.707825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30886-b15f-4843-b37a-13d838003925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.728716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-09e30886-b15f-4843-b37a-13d838003925 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:34.729896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-09e30886-b15f-4843-b37a-13d838003925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:34.774418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 242/488] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:34.775343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.818813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 247/489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:34.819933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30886-b15f-4843-b37a-13d838003925 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.895577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c630b-54bc-4663-a43f-ca042b5345d3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:34.930534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:34.931211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.931490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.931762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.932496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:34.932596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30886-b15f-4843-b37a-13d838003925 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:34.933002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:34.934210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:34.952140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 243/490] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:34.953094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:34.975938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:34.976731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:34.977009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:34.977280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:34.987804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:34.995609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:34.999684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:35.001602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 248/491] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:35.003313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.056340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23994063-5893-4150-a300-7b9a07cfb142 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.090783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.091672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.092053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.102541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.108754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24051c3-78f0-47b5-98fc-fb759b5778c7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.114127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:35.122647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:35.123767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:35.124690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:35.130117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 244/492] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:35.131659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.143790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.144587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.144866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.145137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.153002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.154491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:35.170494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:35.173535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 249/493] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:34:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:35.175940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.240418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3a38-3f61-4a5c-8568-15afa450c3f3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.272965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.273634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.273914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.274212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.274955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:35.275255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.276620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b512-da4a-4061-802f-cba5048f4df5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.277085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c25c-0a39-4529-930f-78a7dfc0972f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.284557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 245/494] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:35.285605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ad8a-fa83-48ca-8fdd-c7978c5e26c5 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.285887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ad8a-fa83-48ca-8fdd-c7978c5e26c5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.286188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ad8a-fa83-48ca-8fdd-c7978c5e26c5 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.288089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 246/495] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:35.290329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ad8a-fa83-48ca-8fdd-c7978c5e26c5 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.315916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.316636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.316920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.317191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.318100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:35.318378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.320013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.328224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 250/496] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:35.329259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.397382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ad8a-fa83-48ca-8fdd-c7978c5e26c5 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.430203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b43-5c3f-4f8a-8fea-84863ab1de20 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.431928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.432597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.432874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.433146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.434062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:35.434373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.435815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1c3d3-8fc3-44e7-bc55-9b6d2fb623b3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.464025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.464970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.465254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.465520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.479393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 247/497] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:35.479393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.479393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.479393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.481231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.482758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.493350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:35.494556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:35.499585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:35.500445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 251/498] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:35.506511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.566849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 248/499] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:35.567825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.619885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52ecf-8186-4722-93f1-4735bf65e61c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.654356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.655165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.655446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.655718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.668566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.669639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5c64e-e93e-4886-84f5-fa175b4454e9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.670060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:35.688904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:35.689817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:35.690746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:35.690746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:35.690746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:35.690746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:35.690746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 252/500] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:35.691459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.708081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.709497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.709982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.710481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.779964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.781356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.791268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df894-ffbf-423d-8eca-b5424a547ef7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.829183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.829845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.830162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.830460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.831188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:35.831499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:35.832907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:35.844894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 253/501] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:35.845531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.878222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 249/502] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:35.879089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:35.939070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e143ad-e84b-477d-a4fc-94f08f5c2a3a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.971459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5fcd-d8f5-4452-9d26-ce8f339e3fe8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:35.971882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:35.972489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:35.972776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:35.973045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:35.982804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-fcb0d2c5-2aec-4b47-b413-13398b4ac1d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:35.990464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:35.999229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 254/503] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.000024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e439a-9d91-4944-9c25-8052746568c5 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.000738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e439a-9d91-4944-9c25-8052746568c5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.000738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e439a-9d91-4944-9c25-8052746568c5 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.000738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 255/504] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:36.000738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e439a-9d91-4944-9c25-8052746568c5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.006981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.007641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.007922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.008196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.008919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:36.009221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.010628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.026542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 250/505] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:36.026542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.092227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e439a-9d91-4944-9c25-8052746568c5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.121782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f756-8435-4f41-aacf-39d57f4d780e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.125262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.126092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.126372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.126640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.134198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.135621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:36.149465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.150424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:36.151340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 256/506] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.151947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.155179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.156003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.156282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.156552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.168223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.169673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b8fd02d0-4632-49ee-bafd-73372d3b4ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:36.186133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.187176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 251/507] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.192561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.205486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:36.206696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:36.244516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa3acc-e8db-4516-b37f-db05e9c8dfe5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.268821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 252/508] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:36.269640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.277014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.277664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.277939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.278259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.279023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:36.279325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.280685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.288433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 257/509] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:36.289204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.364524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264807c-9dda-4fda-baf1-065ca4849584 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.388290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162850-035d-4d0f-ae19-4c4f57f0e1ef None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.395642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.396988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.397264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.397533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.404841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.406331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:36.422286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.423216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:36.424123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 253/510] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.424702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.424790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.424859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.424859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.424859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.425652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:36.425959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.427458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.463332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 258/511] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:36.464163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.522427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43e65-ce2e-4856-bd0e-340407c25f73 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.555795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.556451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.556729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.557007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.557723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:36.558073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.558993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a847f6f-bd52-42ea-9725-ff60e7c64620 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.559447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.570385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 254/512] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:36.571164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.591741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.592526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.592804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.593074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.602715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.604167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:36.621313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.622202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.623060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:36.623060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:36.623060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.623060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:36.623060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 259/513] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.623647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.667996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8b77-a1eb-4cfe-9487-1f1447fd0657 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.699285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.700058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.700334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.700608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.711092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.712528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.725844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052c5-be2f-4183-87a5-70e829830fae None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:36.728746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.729593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 255/514] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.730714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.766829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.767622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.767969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.768308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.769217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:36.769585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.771725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.788174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 260/515] 10.222.0.26 () {56 vars in 1139 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:36.788970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:36.830766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c211be6-fcf1-46e8-95e2-4f4c1760c28b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.862544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.863183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.863463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.863735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.881342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c27f0-59cd-44d0-9aed-8b69c6c66cc1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:36.913087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:36.913862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:36.914165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:36.914439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:36.920915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.922393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.931679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:36.933122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:36.936085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:36.937081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 261/516] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:36.937974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.027837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 256/517] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:37.053642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.053779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636d49-e6a3-4b27-a1f0-caaf164f6047 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.065982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.066709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.066928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.067249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.068561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:37.068863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.070512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.081662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 262/518] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:37.082478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.122792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23214-bb8c-4a08-a12a-3d1975928962 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.157057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.157636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.157910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.158202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.158913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:37.159214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.160574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.172069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 257/519] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:37.172865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.182417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050947-9591-416c-8c99-71e63d219e1e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.215609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.216240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.216511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.216775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.267803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3440a-9db4-44c0-8ceb-646a1bf985da None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.279392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.280826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.299745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.300392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.300673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.300946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.301727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:37.302048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.303498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.320652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 258/520] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:37.321443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.371533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 263/521] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:37.372358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.414720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3247f-4cb5-4889-bc7a-d8bff0a40b59 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.447727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.448503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.448783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.449053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.458678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.460128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.462861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04626afb-5969-4fac-8e72-5ad4df778feb None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:37.477397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:37.478453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:37.479519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:37.479519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:37.479519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:37.479519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:37.479519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 259/522] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:37.480032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.499355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.500137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.500414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.500682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.507501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.508941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:37.523134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:37.524046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:37.524956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 264/523] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:37.526188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.573022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d32b7-bd67-43b5-8392-316b4ceaecf6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.604492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.605135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.605411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.605679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.606400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.607865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.618428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc475-5e3e-42a5-8602-3b162d7b08ba None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.650599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.651233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.651513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.651786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.652612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:37.652917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.654367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.659524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 265/524] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:37.660291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.702647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 260/525] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:37 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:37.703882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.787493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae1a3-1b68-4bc0-b186-8958e1a8301b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.835856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.837005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.837475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.837982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.847499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24fda-cb1e-4289-9be1-11b753aeab6b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:37.851579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.853344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:37.873070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:37.874006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:37.874908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:37.874908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:37.874908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:37.874908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:37.876681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 266/526] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:37.877704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.889636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:37.890539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:37.890921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:37.891290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:37.892138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:37.892535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:37.894047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:37.908380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 261/527] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:37.909395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:37.983604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650645-17c5-4e5c-963d-c701d4d3520c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.012517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815d1e-0fc2-4a09-afff-867768f74c9a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.017112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.017791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.018158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.018445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.019298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.019603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.021630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.040263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 267/528] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.041126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.053275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.057528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.069265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 262/529] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.070147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.149726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597881c-247c-4df7-8d4d-bef95f2f5850 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.174368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fe77-ca20-45dd-add2-100558cfd4d8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.185035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.185831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.186132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.186403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.194298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.195796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.208647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.209290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.209568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.209838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:38.209940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:38.210910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 268/530] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:38.212648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.279159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.280576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.311335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbcc9-951f-465e-871b-45fe65efca1b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.345544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.346371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.346656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.346932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.353636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.355115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:38.369469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:38.371607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 269/531] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:38.373819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.383785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 263/532] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:38.384690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.475696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b645-37d5-4574-96d4-fb33079cbabf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.488665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902686d-c79f-4063-8335-2b6337bd9327 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.510277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.510944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.511225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.511501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.512296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.512601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.514055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.522880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.523536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.523815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.524083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.524860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.525161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.526653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.532830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 270/533] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.533729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.539306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 264/534] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.540200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.635766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63311b06-1472-4b39-bd11-8dba665911fd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.640977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9968af-9303-4062-b772-4911ce886c3e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.670857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.671645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.671924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.672195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.675318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.675966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.676246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.676516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.677876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=53a21a1e87b44b35a3c82c69830b3b44) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.678210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.679642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.682787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.684230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.685744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 265/535] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/role_assignments?user.id=53a21a1e87b44b35a3c82c69830b3b44&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.686648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:38.703645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:38.704579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:38.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:38.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:38.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:38.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:38.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 271/536] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:38.710675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:38.792436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320417-28be-49f9-82e7-e4888afee1ae None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.815586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0384f-d2b4-4591-91e8-9ecd64eaef08 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:38.828158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.828817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.829098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.829372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.830235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=b3e3032053704bdb8283b139a95d1817) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.830545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.831985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.838578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 266/537] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/role_assignments?user.id=b3e3032053704bdb8283b139a95d1817&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:38.856205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:38.856982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:38.857488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:38.857828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:38.858752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:38.859125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:38.860627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:38.876154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 272/538] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:38.882386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:39.008763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082c4ad-b07f-471a-b7f5-fad867f824a5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:39.046707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:39.047435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:39.047713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:39.047981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:39.056247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:39.057710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:39.074344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:39.076419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:39.078696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 267/539] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:39.081960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:39.236173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d71c-1591-4d51-9b1c-f4783711d945 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:39.290645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:39.291754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:39.292281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:39.292764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:39.293754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:39.294298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:39.295943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34750e-1464-4119-bd81-ddf6067778ee None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:39.315093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 273/540] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:39.321095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:39.486661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add288-4420-4a80-9b02-f1373a9360f1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:39.538001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:39.539107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:39.539634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:39.540098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:39.541125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=1b674fd55d7c4ea4bed85a42588278ce) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:39.541657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:39.544464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c017b75-7a4b-4bab-86ca-89c7b0f83c97 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:39.556516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 268/541] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:39 2022] GET /identity/v3/role_assignments?user.id=1b674fd55d7c4ea4bed85a42588278ce&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:40.361362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd61e-6c1e-4b99-9aff-3a065ac77925 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.361865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd61e-6c1e-4b99-9aff-3a065ac77925 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.361865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd61e-6c1e-4b99-9aff-3a065ac77925 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.363490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 274/542] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:40.368674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.369065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.369251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.373835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daa50-8255-4940-9797-2bf2ef257df7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.374146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daa50-8255-4940-9797-2bf2ef257df7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.374424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52daa50-8255-4940-9797-2bf2ef257df7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.375935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 275/543] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:40.380910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.381192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.381464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.405141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:40.406348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:40.409018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:40.410203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:40.520027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 276/544] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:40.540575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 269/545] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:40.550615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:40.563588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:40.659075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab076d-84b0-4f30-8d28-760a43e30ea3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:40.702758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:40.703935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.704413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.704904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.710114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e9e5-0ac2-4b73-9905-ac77f4b0b83f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:40.728996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:40.736961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:40.737879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:40.738747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:40.745677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 277/546] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:40.751498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:40.752871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:40.753674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.753954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.754249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.777214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:40.784898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:40.785883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:40.786778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:40.787399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 270/547] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:40.793213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:40.925293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa44b3-83f7-4e53-9129-a2a650f1f106 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:40.963886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633dac7-caf9-42a1-a9a6-af2b304b4270 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:40.965643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:40.966331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:40.966610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:40.966878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:40.967630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:40.967925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:40.969303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:40.986411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 271/548] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:40.993138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.038226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.038513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.038787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.039554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:41.039860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.041244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.085811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 278/549] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:41.096003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.134815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fd4e9-37bb-4c0b-ac2e-64b346320cf8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.180730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.180730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.180730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.181934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.201333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.202840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.229409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfff7-e689-4912-a1a0-1d9b8170883e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:41.242038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:41.242900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:41.243755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:41.243755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:41.243755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:41.243755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:41.245942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 272/550] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:41.251489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.263367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.264166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.264449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.264727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.275548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.277016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:41.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:41.295478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:41.296330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:41.296330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:41.296330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:41.296330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:41.296330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 279/551] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:41.301420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.401720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d176-f533-4366-bd57-e67d9d381a1d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.436412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.436999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.437278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.437552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.438301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:41.438609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.439991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.452893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 280/552] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:41.458254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.483987 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f646ab-5bb4-45a1-8984-c5437ae187de None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.563627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea441d-0fc8-419b-84ac-da1772381e02 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.575844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.576768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.577220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.577635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.578533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:41.578976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.580496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.602504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 273/553] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:41.604339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.610326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.611141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.611421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.611694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.629818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.631370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:41.656393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:41.657373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:41.658320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 281/554] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:41.667949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.742516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44b20-933c-4d0b-b4a3-d90c64eb175a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.778056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.778723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.779004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.779277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.787452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.788912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.794348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32879-222b-47de-8a5b-a8e885f3c0e0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-6ca01809-244e-458c-ba04-1c3538bbaf19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:41.803196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:41.804200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:41.805128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 274/555] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:41.805714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7b90-8abd-4139-bb17-5b7d184980f4 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.806320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7b90-8abd-4139-bb17-5b7d184980f4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.806320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c7b90-8abd-4139-bb17-5b7d184980f4 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 275/556] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8559a0-c10a-4d21-adcb-d43ae2de0e1c None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8559a0-c10a-4d21-adcb-d43ae2de0e1c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8559a0-c10a-4d21-adcb-d43ae2de0e1c None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 276/557] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:41.811421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8559a0-c10a-4d21-adcb-d43ae2de0e1c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:41.835868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.836875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.837373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.837832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.838839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:41.839320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.840748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed81bd-08c3-4010-8b33-fe76f5ad84e6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.859017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 282/558] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:41.860294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf42ab-c867-4165-b057-64d745bca2c4 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.860580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf42ab-c867-4165-b057-64d745bca2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.860853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf42ab-c867-4165-b057-64d745bca2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.881457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9aaf42ab-c867-4165-b057-64d745bca2c4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:41.882689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9aaf42ab-c867-4165-b057-64d745bca2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:41.924381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8559a0-c10a-4d21-adcb-d43ae2de0e1c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:41.951777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 283/559] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:41.962187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.962187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.962187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.968381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:41.969122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:41.969475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:41.969817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:41.970761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:41.971142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:41.972640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:41.978051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:41.979336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:41.990565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 277/560] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:41.991384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.061621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 284/561] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:42.071097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.099005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327adf9d-3b07-456f-9af2-f849913d895d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.134539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.135187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.135469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.135738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.192689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425dc8-9e50-4570-a177-660e7066508e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.210986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.212444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.226388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.227175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.227454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.227721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.237613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:42.245263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:42.246232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 285/562] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:42.247578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.307394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 278/563] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:42.308228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.340266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3e8f-65c6-46b4-ad48-e46300e6bafa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.371025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.371789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.372062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.372324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.382693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.384117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.399894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40a23f-345f-4fc8-b39e-a7c605f71a5f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ca528489-a3c8-4740-bc92-7b40da2d97b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:42.400080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:42.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:42.402462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:42.402462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:42.402462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.402462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:42.402462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 286/564] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:42.402768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11367a4-e7e4-4f08-a946-e1731fc16bc4 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.403160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11367a4-e7e4-4f08-a946-e1731fc16bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.403259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11367a4-e7e4-4f08-a946-e1731fc16bc4 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.404617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 287/565] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:42.405153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11367a4-e7e4-4f08-a946-e1731fc16bc4 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.432408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.433189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.433461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.433731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.443874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:42.451704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:42.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:42.453664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 279/566] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:42.454389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.501127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11367a4-e7e4-4f08-a946-e1731fc16bc4 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.532521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.533165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.533441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.533712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.534476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:42.534776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.536123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.544242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 288/567] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:42.544828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.551991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812be9-042e-4c7d-8adb-bbd2746e2c00 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.584066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.584836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.585113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.585387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.595606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.597033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-56d5fb74-188c-406d-a826-99166ab5545e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:42.613590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:42.615219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:42.616137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:42.616137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:42.616137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.616137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:42.616137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 280/568] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:42.616764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.617055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.617321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.633391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:42.634615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:42.637459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338cfd-6adb-48ae-a5cd-c8aa8215ca3e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.668091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.668726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.669000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.669267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.669985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:42.670299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.671643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.683146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 289/569] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:42.683911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.697990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 281/570] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:42.698846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.776813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e549f-4431-4bc9-8db0-ddc1e11e18b4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.791005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb22cd-70db-478e-8ff4-f804f8ac246b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.808284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.808928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.809201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.809469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.810243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:42.810537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.811882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.819741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 290/571] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:42.820524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.823417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.824488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.824621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.824881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.834714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.836134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:42.853348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:42.854424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 282/572] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:42.855787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.913792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24852e-1de2-41e5-aee6-5d433948d183 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.945061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.945700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.945977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.946285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.946986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:42.947279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.947541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45b5-1415-44bb-8742-927d06131511 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:42.948632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:42.959636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 291/573] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:42.960403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:42.979810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:42.980586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:42.980866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:42.981118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:42.987530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:42.988958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:43.002222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.003310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 283/574] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.004753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.055548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe38db-6910-481b-9e84-035f724c09da None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.087410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.088191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.088467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.088737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.097655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e15e-d027-4a99-8577-1d97f3471f80 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.102173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:43.109866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.110900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 292/575] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.111765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.130432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.131210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.131489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.131758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.142695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.144134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:43.160816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.162448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 284/576] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.163447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.214652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af50eb-44e2-47e6-a7d6-b1dab77f13e3 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.252273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.252926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.253202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.253468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.254228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:43.254530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.255903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.267165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 293/577] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:43.267947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.280401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674c71-d263-402c-8cdf-c67430d27dc1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.312243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.313019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.313301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.313574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.320300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.321727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:43.336010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.337032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 285/578] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.337945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.361583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd363-d2c9-4075-b3af-680d121bb57e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.393061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.393710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.393990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.394291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.395071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:43.395375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.397339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.408268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 294/579] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:43.409049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.431064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905468f9-7350-4663-8f0e-5da80a001769 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.463011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.463654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.463936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.464204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.464937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:43.465239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.466615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.474668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 286/580] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:43.475448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.506784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd8da-20c0-4f88-bff2-b73568d7ae19 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.543329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.544005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.544284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.544556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.545365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:43.545670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.549031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.561690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 295/581] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:43.562393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.576508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524648e9-2391-41e2-97fe-d744b014127c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.608387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.609174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.609453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.609728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.617047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.618468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:43.632627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.633595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 287/582] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.634826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.660166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892ccf-40cd-4e0b-b6c0-6285c7198164 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.691447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.692090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.692369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.693169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.693949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:43.694525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.695940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.706835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 296/583] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:43.707614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.729023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db049a-4b48-411e-a249-5d94a7eb72a5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.760240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.761110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.761386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.761654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.775773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=7140d54b537b43f588f282cd39120eb9, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.777202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.800616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ad033-2340-4505-ab76-df0d31986be7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.833291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:43.834227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:43.834454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:43.834728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:43.845029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:43.846515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:43.862812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:43.864326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 297/584] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:43.865754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.877927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 288/585] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:43 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:43.877927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:43.976643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72668b-1185-44d1-9ccf-a474f7b8f22a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:43.977456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75503b1-d13a-455b-bb64-ccdc36fe1d6c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.011566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.012379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.012658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.012930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.016367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.017046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.017327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.017599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.018495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.018852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.020332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.021310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.022803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:44.037540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:44.039082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:44.044895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 298/586] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:44.045522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 289/587] 10.222.0.26 () {56 vars in 1139 bytes} [Thu May 5 13:34:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.045522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.045673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.146350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9b507-a079-471b-9062-1151deb32a86 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.146557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8bcb-4f62-4800-a317-6da27da823bf None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.180267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.180474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.180925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.181207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.181481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.181954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.182350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=d5f07d46de6e48e19f316d764d86fd4c) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.182663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.182765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.183187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.184070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.184173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.184641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.186170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.189473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 299/588] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/role_assignments?user.id=d5f07d46de6e48e19f316d764d86fd4c&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.190288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.199682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 290/589] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.200951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.305601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f926-5a9c-453a-8672-8da127a055ae None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.307987 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e44ad7-eb0b-4392-a4b5-31fe9d17fd18 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.341661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.342593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.342939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.343372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.344896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.345738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.346201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.346643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.347657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.348113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.349749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.355438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.357048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.369845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 291/590] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.371006 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:44.375602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:44.376577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:44.377503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:44.377503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:44.377503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:44.377503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:44.382107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 300/591] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:44.383189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.477408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332b3-53c7-43d1-accf-f2b41510c006 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.489618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0835b-b209-495a-a0e7-3264e1caf49e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.513477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.514598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.515063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.515514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.523817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.524611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.525474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.525817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.526179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.526310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.540633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:44.541635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:44.542628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:44.543590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:44.544148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.544221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 292/592] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:44.544794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:44.562493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:44.563536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:44.564454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:44.564454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:44.564454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:44.564454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:44.566868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 301/593] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:44.568461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.649954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f418d-31bc-407d-bbd9-7c81334a568c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.669161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51b4aa-5e5f-43ac-8bd2-c5401eafc65a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.684601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.685255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.685531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.685803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.686544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.686841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.688326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.700044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 293/594] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.701118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.714040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.714040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.714040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.714040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.714450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.714450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.714450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.733339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 302/595] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.734212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.831857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e9914-248d-4cef-8c78-e50ae6c4edea None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.841044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c58d-7bac-4c2c-aa57-ca6e1ca8565b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:44.866552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.867554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.868053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.868527 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.869448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:44.869979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.871577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.875255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:44.876046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:44.876319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:44.876587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:44.883853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:44.885303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:44.885761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 294/596] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:44.886883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:44.900590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:44.901559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:44.902515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:44.906515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 303/597] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:44.907354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:44.998064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708e59-553b-4acd-a45c-cf0adc851c7b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.009003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b47dc-d6e8-45d0-8ba6-aa98c6955060 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.027085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.028299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.028819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.029305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.041694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.043569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.047267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.048064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.048342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.048613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.056215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.057658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:45.063497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:45.064434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:45.065388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:45.065388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:45.065388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:45.065388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:45.067319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 295/598] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:45.068838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:45.076151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:45.077047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:45.077975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:45.079461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 304/599] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:45.085165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.200594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399e5e-5bb2-4a48-bbe9-175812ad68d2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.206694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf01160-e44e-429c-b5e4-5f9a3ff75bee None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.236223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.236884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.237160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.237432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.238167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:45.238466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.239864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.243492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.244418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.244903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.245402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.246424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:45.246952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.248636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.261531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 296/601] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:45.261716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 305/601] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:45.268375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.269969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.366465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36693d8a-9699-4214-911d-1311c6c8033b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.373263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae595-92b9-495a-a08d-52cc7d6d1222 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.400814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.401470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.401766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.402103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.402821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:45.403114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.404522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.409870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.411022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.412082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.412583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/b3e3032053704bdb8283b139a95d1817/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.422853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 306/602] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:45.422853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.433448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=b3e3032053704bdb8283b139a95d1817, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.435347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.497731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 297/603] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:45 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/b3e3032053704bdb8283b139a95d1817/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:45.508197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.542307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404ffda-b74c-41a1-9509-6d5f3e877c48 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.592742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.593556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.593839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.594144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.602044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.603584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:45.619056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:45.620043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:45.620952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 307/604] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:45.626369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.732725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c37de-1f25-4ed4-abfb-19d984c78c75 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.760104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f504a1-5577-4ecf-9a11-53dc7f34971b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.767990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.768718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.768999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.769271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.770244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:45.770557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.772612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.785471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 308/605] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:45.797099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:45.811745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.813274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.813565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.813840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/53a21a1e87b44b35a3c82c69830b3b44/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.834376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=53a21a1e87b44b35a3c82c69830b3b44, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.839699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d835-971a-4814-a141-7c52d3ee8fff None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:45.917695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac5db-e6d3-4b21-9bc7-3791b1149479 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:45.943333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 298/606] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:45 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/53a21a1e87b44b35a3c82c69830b3b44/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:45.966760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:45.967710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:45.967994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:45.968267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/1b674fd55d7c4ea4bed85a42588278ce/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:45.987046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=1b674fd55d7c4ea4bed85a42588278ce, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:45.988635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1cce8-8905-4e00-8652-d0b169ac727a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:46.069851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 309/607] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:45 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/1b674fd55d7c4ea4bed85a42588278ce/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:34:46.191779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869822f7-f5c6-4473-ad7c-74475f0d9281 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.192142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869822f7-f5c6-4473-ad7c-74475f0d9281 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.192333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869822f7-f5c6-4473-ad7c-74475f0d9281 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.194940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 299/608] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:46.200943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.201245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.201501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.219309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:46.220527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:46.296387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 310/609] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:46.319955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869822f7-f5c6-4473-ad7c-74475f0d9281 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:46.422600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869822f7-f5c6-4473-ad7c-74475f0d9281 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:46.458167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:46.458984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.459269 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.459541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.471777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:46.480288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:46.481318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:46.482199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:46.486144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 300/610] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:46.487870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:46.601735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d086-dc0a-4a72-89e1-f355f31f1be2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:46.644873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:46.645591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.646404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.646680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.647437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:46.647739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:46.649111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784fada-30a7-4958-9402-18b21776a299 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:46.659512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 311/611] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:46.665125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:46.750401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5a81-8a2e-4abd-828e-84a848a91130 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.750728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5a81-8a2e-4abd-828e-84a848a91130 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.751092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5a81-8a2e-4abd-828e-84a848a91130 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.752627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 312/612] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:46.769450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.769739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.770029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.795217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:46.796684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:46.819685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b01-2a0e-4b72-a081-2dc84753340f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:46.863846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 313/613] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 05 13:34:46.873509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:46.874334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:46.874618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:46.874892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:46.888033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:46.892869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:46.894366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:46.922304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:46.923281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:46.924178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:46.924178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:46.924178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:46.924178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:46.924178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 301/614] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:46.929672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:46.994268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242e16-261c-4f7e-ab2a-92cd7f6d8cb2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.039423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.040672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.041148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.041617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.047836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992afb8-3c44-4ecc-a0fa-7f528784fc0f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.053030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:47.061038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:47.061974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:47.062862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:47.065532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 314/615] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:47.071865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.099516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.099516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.099516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.099516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.099929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:47.100195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.111404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.125472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 302/616] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:47.131676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.243645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbf44-4e5b-4421-8806-7691ccbc1b3d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.265268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8737-613f-4a95-a94c-23e511a1ce9f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.303246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.303920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.304201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.304476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.305230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:47.305530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.306934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.308849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.309628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.309904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.310199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.321426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.322897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.328847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 315/617] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:47.332574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:47.344285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:47.345291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:47.346890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 303/618] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:47.359159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.452398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459d963-ddb1-4cb0-97d5-4bbb3ccd721e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.486133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.487284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.487782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.488250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.499649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.501378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:47.518682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:47.519640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:47.520565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:47.520565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:47.520565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:47.520565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:47.522888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 316/619] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:47.534964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.539188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554606a-2818-454e-8d90-a79eed280275 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.595536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.596274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.596558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.596837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.597740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:47.598069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.599561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.638390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 304/620] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:47.648944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222cbe9-f403-4fb1-8f17-fb8fa34015aa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.650152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.685576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.686669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.687203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.687676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.688610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:47.689110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.690694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:47.704055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 317/621] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:47.708900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:47.811620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44894c9-651b-42f8-b44d-a0b143408d66 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.851422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:47.854240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:47.855690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:47.856171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:47.941621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf86535-468d-46c8-a673-8b1872338493 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:47.943473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:47.946334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.039032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.040097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.040097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.040274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.058339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 305/622] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 13:34:48.059177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.060149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.060635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:48.076709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:48.077724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:48.078807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:48.086326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 318/623] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:48.087240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.179163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff51a6b-3144-45de-9fd7-d04d01adeb0d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.230871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.232139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.232625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.233100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.252619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.254488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.261733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a1ba-4876-4195-94cc-8c6c910a043e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:48.283160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:48.284119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:48.285041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:48.285041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:48.285041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:48.285041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:48.294852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 306/624] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:48.301703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.302787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.303399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.303676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.307417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.307417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:48.307417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.307417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.331721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 319/625] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:48.337432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.455289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b96872-36f9-4ac6-8698-233934e37450 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.475605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280729-d47f-4b0e-b3f7-4f13fb58a602 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.498635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.499302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.499579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.499848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.500573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:48.500872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.502255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3716a-f113-4623-900d-8d219cd3ee4f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.518740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 307/626] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:48.518740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ecf1-11a9-4fef-b375-a8f0e1d84a4c None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.518740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ecf1-11a9-4fef-b375-a8f0e1d84a4c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.518740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ecf1-11a9-4fef-b375-a8f0e1d84a4c None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.521652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 308/627] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:48.522471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ecf1-11a9-4fef-b375-a8f0e1d84a4c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.523691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.524718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.525427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.526869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.541384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.543960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-00691484-6535-42c8-90dc-d469dc5a0baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:48.564898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:48.565866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:48.568125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:48.568125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:48.568125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:48.568125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:48.571541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 320/628] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:48.573049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.573335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.573610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.590361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:48.591528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:48.652204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ecf1-11a9-4fef-b375-a8f0e1d84a4c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.659204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 321/629] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:48.660040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.690480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.691642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.692157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.692705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.701488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.703551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:48.718818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:48.719799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:48.720740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:48.725058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 309/630] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:48.725937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.790005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dca39-fe0d-47f0-bb0b-ecc4ac99b106 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.824030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.824699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.824978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.825264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.825979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:48.826312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.827676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.831000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3c15-08f2-4800-a1a4-e8630a8fde79 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.843544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 322/631] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:48.843544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.869349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.870186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.870469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.870748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.880811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-071784cc-9c76-47c4-bf55-fcc0537d52d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:48.888475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:48.889448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:48.890344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 310/632] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:48.891159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14e13-cb24-4fcb-a168-7c58efd56dd9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.891159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14e13-cb24-4fcb-a168-7c58efd56dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.891632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14e13-cb24-4fcb-a168-7c58efd56dd9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.892879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 311/633] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:48.894836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd14e13-cb24-4fcb-a168-7c58efd56dd9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:48.946203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd5594-3ae5-4d73-b239-9fa3122a517c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.977387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:48.978057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.978340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.978613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:48.979394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:48.979697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:48.981123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c44481-a891-40bd-b618-d5b55b95340d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:48.992597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd14e13-cb24-4fcb-a168-7c58efd56dd9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:48.993137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 323/634] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:48.994363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617eaa7-beda-4317-b245-d6b09dc72a33 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:48.994648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617eaa7-beda-4317-b245-d6b09dc72a33 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:48.994923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617eaa7-beda-4317-b245-d6b09dc72a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.010396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c617eaa7-beda-4317-b245-d6b09dc72a33 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:49.011560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c617eaa7-beda-4317-b245-d6b09dc72a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:49.024762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.025548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.025831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.026135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.032634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.034085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:49.048467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:49.049380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 312/635] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:49.050890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.077901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 324/636] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:49.079275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c75c-979c-4141-8e7d-293d04366516 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.079556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c75c-979c-4141-8e7d-293d04366516 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.079827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c75c-979c-4141-8e7d-293d04366516 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.081075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 325/637] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:49.081759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c75c-979c-4141-8e7d-293d04366516 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.162400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be625e0-9adb-4dc8-af30-497165ccf403 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.177839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c75c-979c-4141-8e7d-293d04366516 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.194691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.195338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.195616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.195883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.196614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.196911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.198282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.205826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 313/638] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.206620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.210311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.210958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.211236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.211504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.212325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.212626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.214055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb488f-1f2f-4ce8-8c96-0e7c379e7525 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.219688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 326/639] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.220852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.221113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.221385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.237928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:49.239177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:49.308813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 327/640] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:49.309704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.324110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce26e-38c9-4bf1-a91a-f3d154f9a26f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.365894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.366554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.366833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.367101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.367896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.368202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.369661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.382886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 314/641] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.383579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.424154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24ae77-30d4-4aae-ae20-5b1d883ef45c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.462641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.464029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.464029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.464029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.480792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:49.485739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655424e1-22e9-44d0-9d81-981d6e5ab0e3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:49.488930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:49.489929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:49.490927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 328/642] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:49.491684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.521427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.522249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.522535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.522801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.532899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.534398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:49.551460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:49.552585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:49.553597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:49.553597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:49.553597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:49.553597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:49.553597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 315/643] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:49.553915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.590509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82687d-f82a-44eb-830d-fb1f6a05acf9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.623434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.624543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.625042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.625545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.636394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:49.644017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:49.644997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:49.646092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:49.650077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 329/644] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:49.650201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6471d-45fa-491a-91a1-80b1e9dd00fd None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.650907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.683256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.684136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.684441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.684714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/d5f07d46de6e48e19f316d764d86fd4c/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.699383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=d5f07d46de6e48e19f316d764d86fd4c, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.700817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.746653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be236f-44d7-4880-b848-fe09e71f5edf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.776753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 316/645] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:34:49 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/d5f07d46de6e48e19f316d764d86fd4c/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:34:49.779892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.780565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.780849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.781159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.781883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.782214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.783626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.788255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.792852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 330/646] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.793573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.906254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e5f8-7e48-4a90-b253-5f5000af76bd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.936184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0779-a3d3-4473-826b-05802d200ec7 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:49.943947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.945263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.945824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.946317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.947316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.947849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.949461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.959577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 331/647] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.960921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:49.980493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:49.982087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:49.982087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:49.982087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:49.982318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:49.982613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:49.983910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:49.997095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 317/648] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:49.998031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.080311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7865751-44f9-497e-adca-822c614472c9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.107610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7577a-f315-4819-b53f-579d998cd8b9 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.122544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.123338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.123616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.123882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.135376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.136818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.149119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.150250 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.150730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.151216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:50.154519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:50.155399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:50.156366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:50.156366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:50.156366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:50.156366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:50.160317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 332/649] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:50.161852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.166109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.167962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:50.189712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:50.190785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:50.191692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:50.191692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:50.191692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:50.191692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:50.195398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 318/650] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:50.196324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.282502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbe505-f0ed-43e5-aed0-3dfb9d4f6837 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.315926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.316915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.317355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.317748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.319757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53d51-38b6-4fc6-a43c-02ba495de011 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.325951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.327528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:50.341884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:50.343071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 13:34:50.344235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:50.345604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 333/651] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:50.346583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.361861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.363182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.363878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.364917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.365978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:50.366772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.368305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.384809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 319/652] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:50.385881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.453519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b4f0-bc2e-47d5-9756-3979a7f028d9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.487728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.488483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.488870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.489137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.490392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:50.490392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.491857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.504105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 334/653] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:50.509496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.509851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5598c9-dce9-4af4-bf48-c3c202422456 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.549785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.550815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.551267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.551706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.553242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:50.553740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.555349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.573898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 320/654] 10.222.0.26 () {56 vars in 1139 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:50.574947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.615747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2cf8-e951-4a6a-ad2b-7af56cfdf537 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.651262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.651803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.652153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.652506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.659941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.661494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:50.675815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:50.677316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 13:34:50.678316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:50.680376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1ee1-952e-4d33-8a42-50dee994a6d1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.682272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 335/655] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:50.683669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.715954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.717131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.717586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.718054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.725621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.727386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:50.742597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:50.743595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:34:50.744558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:50.747237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 321/656] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:50.748184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.788804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b8e2-a3c4-430f-88a2-b78dc670cab5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.860942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634612-3f92-4e6c-b41a-baa5ac7c4290 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:50.900424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.901402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.901855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.902350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:50.903367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:50.903844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:50.905461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:50.924294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 322/657] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:50.925411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:50.954309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:50.955062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:50.955457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:50.955736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.026867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.028362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.029004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07068f-7c93-4401-bd70-dca0caacc242 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.063674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.064652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.065121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.065567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.066607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:51.067096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.069474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.087926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 323/658] 10.222.0.26 () {56 vars in 1137 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:51.089042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.134873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 336/659] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:51.136117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.188034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9eb8e-1c4f-4f1c-84f2-d860fc4c5022 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.222929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.223897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.224373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.224818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.234538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42697a3a-3c1c-4394-8660-78f0ade1c728 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.274468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.275326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.275698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.276231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.294585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.296287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.361629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.363410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.400261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 324/660] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:51.401444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.486535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 337/661] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:51.487698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.529316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1924-52c9-45bb-bfb2-064800e0c233 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.574718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.575508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.575788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.576058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.590292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3430-9dde-4bec-b46c-8874fb55f851 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.590836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.592475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:51.615703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:51.616674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:51.617596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:51.617596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:51.617596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.617596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:51.617596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 325/662] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:51.618348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.628496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.629277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.629547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.629835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.639924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.641357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:51.659034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:51.659989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:51.660913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:51.660913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:51.660913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.660913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:51.660913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 338/663] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:51.662331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.723240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ee4ee-9fdd-4e70-a13a-f04ba54e6734 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.757100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.757661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2df82-cc78-4051-92c1-862c0e7ed85d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.757890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.758199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.758472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.768697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.770165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-887a4b80-e21f-43f6-9f4b-ea5cad70b63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:51.788038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:51.789181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:51.790454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:51.790454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:51.790454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:51.790454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:51.793795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 326/664] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:51.795363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd0ea7-1a76-44eb-969b-eacec55b93eb None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.795651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd0ea7-1a76-44eb-969b-eacec55b93eb None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.795929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd0ea7-1a76-44eb-969b-eacec55b93eb None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.796682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.797340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.797625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.797893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.798720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:51.799025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.800375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.801348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 327/665] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:51.802180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd0ea7-1a76-44eb-969b-eacec55b93eb None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.812467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 339/666] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:51.813360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.918135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0e01-d7df-426c-9b00-cfdd9da0b455 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.922391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd0ea7-1a76-44eb-969b-eacec55b93eb None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:51.957041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.957927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.958845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.959125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.959407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:51.959867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:51.960068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.960165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.960348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.960617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.961338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:51.961559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afff94-faaa-439b-a9cd-c1a6a85c9f1a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.961653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:51.963039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:51.974630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 340/667] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:51.975272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 328/668] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:51.976236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:51.980446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:51.980733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:51.981009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:51.997187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:51.998440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:52.066814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 341/669] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:52.068035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.088457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8307-2f2c-4ed9-a7a5-4b114ffc928f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.124863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.125645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.125916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.126201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.133219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.134678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:52.148401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:52.149335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:52.150290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 329/670] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:52.159036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.169654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cdbee-068b-4271-b7b0-0ef7a19ca47b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.204424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.205215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.205494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.205764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.212355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.213794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:52.226954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:52.227870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.228845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:52.229285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 342/671] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:52.229857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.257574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eac4f-d42e-4e69-808e-bc5f39c06b2c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.290114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.290888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.291168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.291439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.297905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.299376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-1d4b3e9d-b672-4dd7-850b-3483df6be325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:52.312595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:52.313482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:52.314451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 330/672] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:52.314952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92111bf-2a8e-4c71-90d7-787efaa1a65e None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.315274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92111bf-2a8e-4c71-90d7-787efaa1a65e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.315503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92111bf-2a8e-4c71-90d7-787efaa1a65e None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.316702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 331/673] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:52.317421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92111bf-2a8e-4c71-90d7-787efaa1a65e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.328009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268423a-baef-433e-96c7-1e165b372722 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.360368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.361154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.361436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.361705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.371551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:52.379055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:52.380054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:52.380941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 343/674] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:52.382112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.416782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92111bf-2a8e-4c71-90d7-787efaa1a65e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.448335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.448923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.449202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.449472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.450282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.450581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.452005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.463419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 332/675] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.464187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.478752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c04819-056b-40c5-a698-16a2bb37fc2e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.510610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.511256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.511536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.511810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.512592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.512895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.514334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2219ec-6509-4ed8-9f33-cee1784d96cf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.526534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 344/676] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.527767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.528117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.528314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.545177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:52.546386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:52.562433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6aee-08c6-4d8a-9df8-0c5588f7e217 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.593923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.594587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.594861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.595127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.595896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.596192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.597597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.608351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 345/677] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:52.613448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 333/678] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.613580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.613693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.707675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3442d-1c92-41ea-8d1d-07073728b70b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.710647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc836-cd3e-4137-8062-12b173c8afaf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.738819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.740010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.740290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.740554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.741367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=b3e3032053704bdb8283b139a95d1817) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.741663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.743005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.743136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.743654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.743928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.744194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.744932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.745227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.746613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.748681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 334/679] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/role_assignments?user.id=b3e3032053704bdb8283b139a95d1817&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.749436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.754755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 346/680] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.755920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.853761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3df62f-d9e9-45a8-bb55-9c98d6c9c6dc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.868631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14c7c2-999f-45a1-9def-ce2279aa3d4d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:52.890359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.891017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.891296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.891565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.892398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=1b674fd55d7c4ea4bed85a42588278ce) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.892705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.894172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.910233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 335/681] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/role_assignments?user.id=1b674fd55d7c4ea4bed85a42588278ce&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.910233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:52.912472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:52.913146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:52.913420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:52.913689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:52.914606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=53a21a1e87b44b35a3c82c69830b3b44) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:52.914913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:52.916421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:52.932762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 347/682] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/role_assignments?user.id=53a21a1e87b44b35a3c82c69830b3b44&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:52.932762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.041877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281ed9-d00d-4d84-b2bd-5c9635cda590 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.045772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c3afc-804a-4c5f-860a-378591ac1bf5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.081100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.081911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.082223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.082494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.083800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.084598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.084871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.085134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.096200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:53.097919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.099477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:53.105137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:53.106170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:53.107045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 336/683] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:53.113942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:53.129069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:53.130373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:53.131312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:53.131312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:53.131312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:53.131312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:53.137916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 348/684] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:53.139592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.253549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6a73-0e78-46af-bd85-ed17ff76ea03 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.260612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee4fd-ac41-4dc3-8ed5-75e8e0bc310f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.296610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.297526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.297822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.298135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.298890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:53.299193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.302677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.312084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.317300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.317439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 337/685] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:53.318008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.318570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.319629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.320156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:53.320683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.322532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.345355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 349/686] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:53.347000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.439660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ae894-023c-441d-a2c8-392e249cd315 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.462847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2c504-44df-4e65-a0fb-1d6377c70f4b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.474802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.475895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.476381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.476875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.487892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.490305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.497344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.498165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.498449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.498723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.506091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.507530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:53.510491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:53.511421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:53.512375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:53.512375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:53.512375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:53.512375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:53.514663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 338/687] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:53.526114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:53.538511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:53.539544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:53.540598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:53.557018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 350/688] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:53.557884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.645272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292dbbd-e956-4810-9b95-c7a295511b2f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.683529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72967659-741b-4211-be35-55b970ef7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.684890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967659-741b-4211-be35-55b970ef7219 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.685375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967659-741b-4211-be35-55b970ef7219 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.685846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967659-741b-4211-be35-55b970ef7219 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.686782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967659-741b-4211-be35-55b970ef7219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:53.687617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967659-741b-4211-be35-55b970ef7219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.689180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967659-741b-4211-be35-55b970ef7219 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.703132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 339/689] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:53.710241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72967659-741b-4211-be35-55b970ef7219 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.816237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0c8-2f99-44f9-a402-4e99754436b2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.817137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72967659-741b-4211-be35-55b970ef7219 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:53.852587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.853820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.854361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.854836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.862952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.864721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:53.880239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:53.881263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:34:53.882671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:53.885057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 340/690] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:53.890946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:53.897608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:53.898304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:53.898588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:53.898865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:53.899708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:53.900012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:53.901528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:53.920555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 351/691] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:53.925662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.046327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604301e1-b513-4898-8e86-3764ec66fbab None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.085304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.085961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.086263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.086534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.103857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714489-0375-41d8-a4ae-0331d620573d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.159191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.159863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.160142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.160414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.161783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:54.162168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.164043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:54.190151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 341/692] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:54.196532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.203046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.204508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:54.310157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 352/693] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:54.323013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.396207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bff37-87de-43ad-b0fe-77a30035dec5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.469740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.470425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.470708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.475585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.528009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42946a-b375-40bf-9f15-f6348ffd92a5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.591448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.592250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.592565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.592854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.611909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.613368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:54.641821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:54.642823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:54.643736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:54.643736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:54.643736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:54.643736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:54.645057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 353/694] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:54.649607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.653009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.654593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:54.755505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 342/695] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 13:34:54.765263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.848329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0838a4-4168-4184-a503-05a1fc534944 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.889019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.889695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.890172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.890452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.891548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:54.891859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.893393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:54.896227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e63cf-28e4-4835-b152-8f7caee2e4cf None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:54.909016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 354/696] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:54.915039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:54.956191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:54.956987 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:54.957263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:54.957540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:54.991187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:54.992660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:55.038357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:55.039525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:55.040792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:55.040792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:55.040792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:55.040792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:55.040792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 343/697] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:55.048823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.049005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df604-1dac-4b36-b135-dadc46fbf3de None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.110905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.111716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.111992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.112298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.129511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.131588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:55.162446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:55.163384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:55.164511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 355/698] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:55.172311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.271209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b753b3-7067-41ff-994b-2a3681b08252 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.307671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67715d4-818f-42ff-a385-92a62d84e182 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.361846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.362592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.362869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.363144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.363945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:55.364286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.371300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.391343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.392023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.392303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.392577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.393308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:55.393611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.395026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.399585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 356/699] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:55.405532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.440809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 344/700] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:55.464316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.564059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613487-2324-4b10-a699-7856a8b095d2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.607839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.608523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.608805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.609075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.609937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:55.610270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.611823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d68a-f886-4403-ab1f-2018e37f81f4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.627025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 357/701] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:55.640452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b665bc-8baf-4636-9216-cbf386dd9cbe None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.640767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b665bc-8baf-4636-9216-cbf386dd9cbe None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.641068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b665bc-8baf-4636-9216-cbf386dd9cbe None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.642819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 358/702] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:55.649218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.649522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.649769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.667979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:55.669213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:55.669372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cdefb-883d-4d3b-9b20-7a15184c1760 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.709151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.709882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.710197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.710472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.717945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.719481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:34:55.734005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:55.735031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:55.736895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 345/703] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:34:55.741593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.743230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 359/704] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:55.766250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.845376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f313-2ce7-4ad1-9026-37b247a06562 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.873809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5cfe-e012-4968-b0ae-fbabc18c5b71 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:55.882215 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.882894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.883171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.883445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.884241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:55.884543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.885991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141751be-04f6-4881-b952-9e8c8ff4c14b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.912491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 346/705] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:55.912491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7c12-8bf0-40e3-a039-4d66a38186e4 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.912491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7c12-8bf0-40e3-a039-4d66a38186e4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.912491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7c12-8bf0-40e3-a039-4d66a38186e4 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.912491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 347/706] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:55.913418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7c12-8bf0-40e3-a039-4d66a38186e4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:55.918767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:55.919599 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.919906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.920179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.920861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:55.922256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c2d69b26-3373-45e4-9fab-729c49c5a0af None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:55.938542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:55.939638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:55.940528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 360/707] 10.222.0.26 () {56 vars in 1129 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:55.945725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4333-0747-448a-8d5d-8d22a697cb94 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:55.951313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4333-0747-448a-8d5d-8d22a697cb94 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:55.951313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4333-0747-448a-8d5d-8d22a697cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:55.963028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6eae4333-0747-448a-8d5d-8d22a697cb94 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:55.964139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6eae4333-0747-448a-8d5d-8d22a697cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:56.042037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 361/708] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:56.042037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d040-f517-47de-91a8-4b7e442f7aa3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.042037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d040-f517-47de-91a8-4b7e442f7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.042422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7c12-8bf0-40e3-a039-4d66a38186e4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.042515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d040-f517-47de-91a8-4b7e442f7aa3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.042515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 362/709] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:56.042515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1d040-f517-47de-91a8-4b7e442f7aa3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.079378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.080290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.080726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.081143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.082323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=d5f07d46de6e48e19f316d764d86fd4c) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:56.082633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.084203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c0a29-16fe-4dc5-ae92-69f3ca67903e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.098248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 348/710] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:34:55 2022] GET /identity/v3/role_assignments?user.id=d5f07d46de6e48e19f316d764d86fd4c&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:56.101305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.101305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.101305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.126114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:56.127612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:56.169404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1d040-f517-47de-91a8-4b7e442f7aa3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.210976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.212108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.212727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.213256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.214796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:56.215294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.217239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.226050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 349/711] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:56.226050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.236184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 363/712] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:56.241817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.359861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f8a50-fa1c-4c79-92fb-3b02b3e64436 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.375316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b235a-d4b4-4eaa-8304-1bbb81f6622d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.401377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.402255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.402725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.403112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.413904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.414968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.415468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.415679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.416156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.417071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:56.417261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.417759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.419378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.425699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 364/713] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:56.426955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:56.437953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:56.439030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:56.440630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:56.440630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:56.440630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:56.440630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:56.440630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 350/714] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:56.445871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.593465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a9a3-6e8c-4201-b889-cc345aad1bb6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.632283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.633334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.633887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.634390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.634813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c8f0-8135-432a-8933-6779d100b4a4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.635582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:56.636110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.637698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.652641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 351/715] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:56.657806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.675138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.675776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.676059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.676336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] PATH_INFO: `/v3/services/network` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.677553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.679011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:56.695564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:56.696629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:34:56.702346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 365/716] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:56.705444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.789547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7ca0-579e-482e-a32d-d7813588b0f0 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.827928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.828596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.828874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.829144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.829859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.835248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab5dd9-1a96-4161-b374-d0ad86a63191 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.874351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d02f1-6434-4989-b128-2255bc336dc8 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:56.908162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:56.908836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:56.909114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:56.909391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:56.910125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:56.910439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:56.912456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:56.917484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 366/717] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:56.922876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:56.953904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 352/718] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:34:56 2022] POST /identity/v3/users => generated 254 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:34:57.070172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7357712-954f-4950-8dc1-66eefb477ec1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:57.110078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:57.110078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:57.110078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:57.110078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:57.110500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] RBAC: Adding query filter params (type=network) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:57.110754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:57.112110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa3222-0a2a-4fd2-a69c-7acb20077967 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:57.117260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 367/719] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:34:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:58.285660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86d9c1-5655-42f8-a7a7-8cfd1f66cec0 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:58.286263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86d9c1-5655-42f8-a7a7-8cfd1f66cec0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:58.286263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86d9c1-5655-42f8-a7a7-8cfd1f66cec0 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:58.287891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 353/720] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:58.299391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:58.299845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:58.299924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:58.326986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:58.328175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:58.413702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 368/721] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:34:58.448298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86d9c1-5655-42f8-a7a7-8cfd1f66cec0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:58.579194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86d9c1-5655-42f8-a7a7-8cfd1f66cec0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:58.622275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:58.623073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:58.623352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:58.623620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:58.645806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:58.653409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:58.654494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:58.655993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 354/722] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:58.660549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:58.827288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a376a7-0332-466a-aec0-a50f83df914a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:58.877670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:58.878811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:58.879314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:58.880360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:58.881352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:58.881887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:58.883538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae02a4-05e2-4f4a-847b-0f043b6d01a9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:58.897895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 369/723] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:58.902933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.042373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a273-3958-40ff-9083-4871e2e91d4b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.080003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66fb0-f5b3-4584-9f61-f2c89e944d1a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.080191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66fb0-f5b3-4584-9f61-f2c89e944d1a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.080471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66fb0-f5b3-4584-9f61-f2c89e944d1a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.082191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 370/724] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:34:59.087755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a864-af00-41e4-bc06-bbfe641a803a None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.088127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a864-af00-41e4-bc06-bbfe641a803a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.088404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a864-af00-41e4-bc06-bbfe641a803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.088677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.089480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.089757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.090044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.102812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.110038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9ff9a864-af00-41e4-bc06-bbfe641a803a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:59.110038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9ff9a864-af00-41e4-bc06-bbfe641a803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:59.110495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:34:59.134352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:59.135325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:59.136665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:34:59.136665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:34:59.136665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:34:59.136665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:59.136665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 355/725] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:59.142725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.181112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 371/726] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:59.186574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1ff-115b-461d-b6e9-c1bebc860750 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.186863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1ff-115b-461d-b6e9-c1bebc860750 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.187173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1ff-115b-461d-b6e9-c1bebc860750 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.188782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 372/727] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:59.194924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.195204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.195478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.223187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:59.224418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:59.247232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8a60f-cd3a-4000-96a4-3f6d2cbb5543 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.282792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.283459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.283738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.284013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.284737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:59.285038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.286469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.297691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 373/728] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 13:34:59.298613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.298885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 356/729] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:34:59.304328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.407113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69376cd3-d6ba-4946-823e-4858e4180fe6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.413646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2109e-5307-4815-81a6-cd0728b1d34b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.444625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.445412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.445694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.445967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.450773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.451440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.451719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.451992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.452718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.453403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.454105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.454850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:34:59.469612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:59.474634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 357/730] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:59.475651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.572920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 374/731] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:34:59 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:34:59.574346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.578908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f0063-4c24-44aa-a8db-2ff5ba868b5f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.632354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00026e-6470-46de-974e-eabae960936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.633580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00026e-6470-46de-974e-eabae960936b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.634129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00026e-6470-46de-974e-eabae960936b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.634624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00026e-6470-46de-974e-eabae960936b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.647362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00026e-6470-46de-974e-eabae960936b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-8c00026e-6470-46de-974e-eabae960936b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:34:59.655723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:34:59.656766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:34:59.657676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:34:59.660644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 358/732] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:34:59.666993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00026e-6470-46de-974e-eabae960936b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.724303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717d639-79a7-46ba-85e5-3f526aa5f9f9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.774804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.775518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.775804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.776074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.776995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:59.777251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.778764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27dadd-7ab8-4bba-be48-d11b3682dc34 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.814192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 375/733] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:59.815643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bee0a-ae6b-433c-9702-7bd57b658909 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.815938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bee0a-ae6b-433c-9702-7bd57b658909 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.816214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bee0a-ae6b-433c-9702-7bd57b658909 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.818377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 376/734] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:34:59.819740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bee0a-ae6b-433c-9702-7bd57b658909 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:34:59.851396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00026e-6470-46de-974e-eabae960936b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.898557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.899235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.899521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.899814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.900560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:34:59.900861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:34:59.902265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63bbe0-54d7-4502-a760-edafcf752dd7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:34:59.911108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 359/735] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:34:59.912230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.912522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.912800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:34:59.931769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:34:59.932955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:34:59.952031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bee0a-ae6b-433c-9702-7bd57b658909 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:34:59.997650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:34:59.998495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:34:59.998779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:34:59.999054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.012939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.014537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.015990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 360/736] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:34:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 13:35:00.017461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:00.036323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:00.041565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:00.042896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:00.042896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:00.042896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:00.042896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:00.042896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 377/737] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:00.045566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.141051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18b61b-7888-460d-b713-5caac89a8a53 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.165310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec425d-f1a4-4f1e-ae75-0e2689a143ec None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.176795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.177588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.177865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.178170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.188164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.189601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.202047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.202717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.202998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.203268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.204029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:00.204531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.207026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1627c-086f-4ba0-9527-4cd3f5d23032 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:00.207997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:00.208955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 361/738] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:00.211190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.226048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 378/739] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:00.227143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765ab9-be89-43ae-8fc6-270d878fe8d7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.227434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765ab9-be89-43ae-8fc6-270d878fe8d7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.227711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1765ab9-be89-43ae-8fc6-270d878fe8d7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.229104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 379/740] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:00.233521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1765ab9-be89-43ae-8fc6-270d878fe8d7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.320197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27430-7064-4b15-b9c7-25957680fa5e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.333393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1765ab9-be89-43ae-8fc6-270d878fe8d7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.353503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.354187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.354471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.354745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.355462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.356850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0385c-7ea1-4ccf-aad5-44f8f90aaae3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.365797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.366477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.366778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.367054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.367772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:00.368075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.369430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.380184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 380/741] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:00.380986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.462133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 362/742] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:00 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:00.462133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.462133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.462133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.474150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:00.475481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:00.498917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08435-48b5-4734-9b07-d3d67a5b1baf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.558379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 363/743] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:00.558885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.559693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.559985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.560240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.560600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.567789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.569510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:00.584681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:00.585694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:00.586677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:00.590927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 381/744] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:00.591910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.679275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637bef-70fe-48f2-ba7f-54f64bb79cf7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.716223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.716939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.717218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.717490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.721676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62908-af31-4ed6-b956-c9b1da39872e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.725318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.726762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:00.741716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:00.742841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:00.743818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 364/745] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:00.744475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.760978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.762063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.762566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.763058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.764045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:00.764549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.766366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.779770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 382/746] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:00.785405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.844588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd90d-e651-4add-afb0-b8c842e7c3ec None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.879591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.880375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.880653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.880928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.891384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:00.894273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fcdf2-3370-4b9b-8596-00339cba4821 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:00.898893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:00.899874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:00.900774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 365/747] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:00.901520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:00.935170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:00.936243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:00.936725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:00.937213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:00.938299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:00.938805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:00.940505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:00.958938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 383/748] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:00.960083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.007814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da6263-efbe-4bd4-b249-c91d9e6a47df None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.035739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.036924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.037201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.037472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.039500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=7140d54b537b43f588f282cd39120eb9, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.040917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.061356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7768e-166e-415e-bce4-7a4b923c7a2d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.114218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.114883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.115162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.115434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.116179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:01.116478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.117903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.126131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 384/749] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:35:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:01.126868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 366/750] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:00 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:01.126979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.134076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.270145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c687cb-f68e-48ed-b8f8-b58d300c6bb6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.314669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.317547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.319602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.320073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.337082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.339297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.356837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea5ec-21ab-4e0c-98e6-0ba3a2421f5d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:01.362650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:01.363780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:01.365008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:01.365008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:01.365008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:01.365008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:01.366936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 367/751] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:01.372712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.396825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.397765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.398267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.398689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.482585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.484052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.493294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0eb9a-eaa0-4fb9-b35d-0bfe64f0016b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.536263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.538596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.539918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.540422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.541391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:01.543771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.547426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.581966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 368/752] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:01.583863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.695318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 385/753] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:01.700785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.720667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba5aa-6e41-4d0f-a807-2edd0adca73d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.766765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.767589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.767865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.768132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.787340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.788802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:01.822728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:01.823758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:01.824826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 369/754] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:01.829734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:01.842656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330947b-322e-459c-b6e1-0fceedd77ee1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:01.885814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:01.887008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:01.887498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:01.887969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:01.910493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:01.913897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:01.955795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:01.956788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:01.958306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:01.958306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:01.958306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:01.958306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:01.964005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 386/755] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:01.969675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.037704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94439a-c154-4a29-87f9-fde70a29cdeb None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.142953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a2fd-9bf9-49e4-a710-71b0fac8e9f7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.143948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.144636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.144919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.145730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.146618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:02.146929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.148374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506e0e8-05db-4fa0-a4d7-eac82eb1de04 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.171039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 370/756] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:02.172442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964f4d-a276-460b-9c53-80fbe15ee317 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.172729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964f4d-a276-460b-9c53-80fbe15ee317 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.173004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964f4d-a276-460b-9c53-80fbe15ee317 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.174787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 371/757] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:02.177377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964f4d-a276-460b-9c53-80fbe15ee317 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.181458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.182156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.182439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.182719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.183475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:02.183783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.185155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25234-5bc5-4775-9eae-c723058e12af None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.204863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 387/758] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:02.204863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.204863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.204863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.223144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:02.225324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:02.285345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964f4d-a276-460b-9c53-80fbe15ee317 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.309285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 388/759] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:02.310457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.323615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.324575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.325060 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.325512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.395262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.397502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.429950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa272f-50b4-4716-8643-0fdffac0198b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.465505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.466441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.466726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.466999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.476470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.478320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:02.496517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:02.497478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:02.498783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 389/760] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:02.499512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.508394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 372/761] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 13:35:02.509589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.618608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d658a0-5897-456d-9561-5c054e62650c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.619908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e7756-157a-4648-be25-15e1ce4f1480 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.652479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.653629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.654185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.654742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.655595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.657190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.666408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.667065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.667350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.667629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.668418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:02.668724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.670159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:02.671516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:02.672487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:02.673388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:02.677018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 390/762] 10.222.0.26 () {56 vars in 1129 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:02.678201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.683676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 373/763] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:02.684515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.788175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e303d-4c88-4022-9143-4ac1da598b11 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.802266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f8d9-5c85-40f0-9f6f-a96a6e989aa0 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.823870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.825128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.825614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.826149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.837710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.837845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.838465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.838746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.839018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.839724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:02.840025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.840829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.841380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.846559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 374/764] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:02.847619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:02.860346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:02.861287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:02.862264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:02.862264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:02.862264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:02.862264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:02.869008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 391/765] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:02.870151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:02.950888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2a5-0415-4ae9-89aa-90996253528c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.978944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071911e-b0cf-4f17-8fac-e923cb7cb9b4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:02.985661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:02.986429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:02.986774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:02.987188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:02.988149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=d5f07d46de6e48e19f316d764d86fd4c) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:02.988518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:02.990552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:02.996390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 375/766] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/role_assignments?user.id=d5f07d46de6e48e19f316d764d86fd4c&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:02.996958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.028710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.030057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.030784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.031685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.033054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.033604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.036940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb86c08-e108-4b54-a505-1883f23989e7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.044300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 392/767] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.046703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a057-e26b-4811-b3f4-eef19d4351b3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.047331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a057-e26b-4811-b3f4-eef19d4351b3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.047929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a057-e26b-4811-b3f4-eef19d4351b3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.050462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 393/768] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:03.052190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940a057-e26b-4811-b3f4-eef19d4351b3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.110744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e0da4-825c-487b-a914-36ac0306b119 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.148247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.149256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.149728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.150321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.151300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.151824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.153440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414bf10-7309-4b24-8a5d-2e1e0dc0bd49 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.167728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 376/769] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.169348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.169777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.170380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.189585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:03.191126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:03.198773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940a057-e26b-4811-b3f4-eef19d4351b3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.237567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.238600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.239072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.239493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.240464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] RBAC: Adding query filter params (interface=public, service_id=3e08cda9189b474c8d1034d7b5a16ca1, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.240942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.242531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.251589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 394/770] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/endpoints?service_id=3e08cda9189b474c8d1034d7b5a16ca1&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.252701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.362823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda2c19-2557-48b4-ad48-2c78527fab54 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.402651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 377/771] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:03.403276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.429867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.430704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.430989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.431264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.440251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.441697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:03.463898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:03.464864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:03.465766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:03.468060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 395/772] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:03.469048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.527650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c916-4cbb-4220-a97d-b2a8e1f7f028 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.582054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5fa2-e74f-4bdd-a732-0880e8f897c5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.584946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.584946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.584946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.584946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.585586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.585586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.590456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 378/773] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.590456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.675956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.677618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.678125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.678611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] PATH_INFO: `/v3/services/network` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.679462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.681035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.703439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882400-07bc-42a5-8064-9b3be23ab123 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:03.714050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:03.715128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:03.715981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:03.722044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 396/774] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:03.732025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.751700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.752373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.752655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.752928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.753727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.754049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.756115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694d4f-bc14-4d09-aae2-e47b205af627 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.769263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 379/775] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.770870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640040c-09fc-4146-90e3-aadfbc2972c3 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.771158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640040c-09fc-4146-90e3-aadfbc2972c3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.771436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640040c-09fc-4146-90e3-aadfbc2972c3 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.776969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 380/776] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:03.777922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640040c-09fc-4146-90e3-aadfbc2972c3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:03.839009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76cb97-8014-487d-86da-bfb6b29fc328 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.877769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.878474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.879081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.879420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.880942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] RBAC: Adding query filter params (name=network) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.881257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.882862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619149-1c28-48cc-9fb7-813438f57032 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.892993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 397/777] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:03.892993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.892993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.892993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.894182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640040c-09fc-4146-90e3-aadfbc2972c3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:03.907555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:03.909038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:03.941997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:03.942759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:03.943046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:03.943325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:03.944735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=508b8f3b14414a3098cb79eaf0721e75) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:03.945047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:03.946773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:03.953673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 381/778] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/role_assignments?user.id=508b8f3b14414a3098cb79eaf0721e75&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:03.958701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.005135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 398/779] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:04.046608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.152526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00417c54-79e1-4831-95a0-388e57bdcd0e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.201956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c110ed8-f958-4500-883e-07431f06f45c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.223567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.224519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.224950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.225368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.226263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] RBAC: Adding query filter params (type=network) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:04.226711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.228230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.237768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 382/780] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:04.241419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.246062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.246062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.246062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.247321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.262548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:04.274033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:04.275212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:04.276272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 399/781] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:04.279230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.390863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f750-87e9-4551-9ec7-e643d900411e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.428767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.429434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.429716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.429990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.430770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:04.434037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.434037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.442595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 400/782] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:04.448597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.465148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6be42-df21-44d4-89c9-8a7eb6c12913 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.522314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.522978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.523261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.523535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.524334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] RBAC: Adding query filter params (interface=public, service_id=a6f3c6be836b4f04a1d68c8a07e01ba6, region_id=RegionOne) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:04.524642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.526027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.550475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 383/783] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/endpoints?service_id=a6f3c6be836b4f04a1d68c8a07e01ba6&interface=public®ion_id=RegionOne => generated 194 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:04.555726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.557823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea1bc-a478-4fbd-b119-c7cc300d92e3 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.595897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.596995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.597282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.597554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.609911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.611474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:04.631966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:04.632929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:04.633852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:04.633852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:04.633852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:04.633852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:04.633852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 401/784] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:04.639382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:04.747272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd6db-f57c-4c79-a402-05cc0b64a48f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.784110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.784779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.785229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.785512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.787165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.788995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.802371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 384/785] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:04.830189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135001a-e476-47b5-8e3e-ff3be938687e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:04.892413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:04.893218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:04.893378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:04.893622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:04.894405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:04.894712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:04.896796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:04.911512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 402/786] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:04.917096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.049378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8520-a561-439d-ad6d-ff96e64ea99f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:05.085349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:05.086521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.087003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.087492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.095190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:05.096937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:05.112591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:05.113556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:05.115153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:05.117832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 385/787] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:35:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:05.123158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.264829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112611ce-d9f3-4930-990a-9e68b1d64aff None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:05.311967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:05.312571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.312848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.313118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.313992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:05.314333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:05.315819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7def6b-d7b8-44ed-887a-cb84faa3b04b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:05.341436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 403/788] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:05.346853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.474511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737ebc-9912-4ab4-9f4c-5089118e6e4c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:05.520701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:05.521371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.521655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.521932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.523644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c7f-0b2b-4d7b-9ad9-ca9b836e441d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.523940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c7f-0b2b-4d7b-9ad9-ca9b836e441d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.524222 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8c7f-0b2b-4d7b-9ad9-ca9b836e441d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.527064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 404/789] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:05.531098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.531388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.531669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.548136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:05.549315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:05.622127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 405/790] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:05.640045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.649405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:05.650942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:05.756281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175bf01-dfd4-4c63-acf2-318db3b54ed9 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:05.778990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 386/791] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:05.787341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.791621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:05.792056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.792339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.792620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.810112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:05.817736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:05.818801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:05.819935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:05.822108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 406/792] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:05.833903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:05.938037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b2cd-9d93-42c9-b569-9e32f37b30e4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:05.980193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:05.980882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:05.981164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:05.981439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:05.982227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:05.982533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:05.983976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:05.992966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 407/793] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:05.998856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.014130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04560b5-cc84-44c6-84c4-41d4e444947c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.083788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.084589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.084869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.085141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.099701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9128a-911a-4f7c-b35e-7eff3ad22541 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.108519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.109985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.133643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.134469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.134753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.135028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:06.145217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:06.146713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:06.147638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:06.147638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:06.147638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:06.147638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:06.147867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.147941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 387/794] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:06.148010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.152820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:06.165721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:06.167872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:06.170028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:06.170028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:06.170028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:06.170028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:06.174278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 408/795] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:06.175168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.315853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235328-7f9a-42c0-8e29-c6f53f62ab4d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.369331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc028-86a4-4a1e-a5f7-a4e3e0b4806e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.382328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.382993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.383268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.383537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.384259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:06.384555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.385909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.402634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 388/796] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:06.406315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.432306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.432966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.433242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.433512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.434257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:06.434553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.435917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014dad4-0dd7-4bd2-966c-6d9ffca296c1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.449642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 409/797] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:06.451752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea681-a30c-4c95-b9e2-9d1b69511b5f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.452038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea681-a30c-4c95-b9e2-9d1b69511b5f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.452311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea681-a30c-4c95-b9e2-9d1b69511b5f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.458080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 410/798] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:06.458080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea681-a30c-4c95-b9e2-9d1b69511b5f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.538407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c2b8-7d31-446d-86a9-232cb135e943 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.582042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.583747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.584032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.584303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.588107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea681-a30c-4c95-b9e2-9d1b69511b5f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.593404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.594946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b9156b8b-c289-4a2f-be2c-b90875b9ba42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:06.613812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:06.614855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:06.615766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:06.620636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 389/799] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:06.622340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.622628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.622901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.636797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.638229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.638724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.639221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.641759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:06.643470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:06.648859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.650582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:06.670262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:06.671245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:06.672206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:06.675226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 411/800] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:06.676477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.734046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 390/801] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:06.734046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.808235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21800cb5-59c9-4e30-a679-fc507b1f9f03 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.830675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6a0e1-d0e9-425e-8d49-9fa1cd518b42 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.849364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.849959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.850744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.851031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.851825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:06.852130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.853652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.863444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:06.864793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.865118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.865394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.866270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:06.866576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:06.868013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d921c-6b51-43ea-8e07-9f40ed8c33c6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:06.871388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 412/802] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:06.872081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 391/803] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306999-6091-42f4-b923-1aaa7670369b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306999-6091-42f4-b923-1aaa7670369b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306999-6091-42f4-b923-1aaa7670369b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 392/804] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:06.891457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63306999-6091-42f4-b923-1aaa7670369b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:06.975585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bdb92-eaf3-4c3b-83b1-5ae3964d536e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:06.992399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63306999-6091-42f4-b923-1aaa7670369b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.011825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.012850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.013281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.013775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.014617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.016184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.025232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.026086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.026367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.026637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.027518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:07.027824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:07.028114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:07.029040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 13:35:07.029933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.031180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558efa7-f5b6-430d-b695-0c81026c0f02 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.034209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 413/805] 10.222.0.26 () {56 vars in 1129 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:07.035056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.042323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 393/806] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:06 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:07.042323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.042323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.042323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.055569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:07.056777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:07.154500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 394/807] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:07.155645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.176029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dfb3-132f-4c28-b867-4847d9e1d17e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.222510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.223477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.225255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.225255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.239870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.241328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:07.263523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:07.264491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:07.265416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:07.265416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:07.265416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:07.265416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.265416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 414/808] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:07.266360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.295436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487578-83ba-45fc-ad2b-bb79931f1a74 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.346142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.346841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.347123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.347397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.348124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:07.349003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.350440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.358201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 395/809] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:07.359016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.386639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ae46-4dbd-42cd-8602-10a281df6dda None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.421472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.422692 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.423197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.423669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.434647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:07.443134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:07.444356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:07.445234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.447961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 415/810] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:07.453512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.474298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579116-edb4-4a5c-8ba0-4087c7d14d5e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.515085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.515901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.516038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.516279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.517025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:07.517303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.518705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.530749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 396/811] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:07.531584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.559139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eb98-568d-4663-9234-f9a002a07dd1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.591396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.592052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.592330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.592604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.593315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:07.593606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.594998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5d34c-129f-4666-846e-5b7d62ef2643 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.600130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 416/812] 10.222.0.26 () {56 vars in 1124 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:07.601330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34858-41dc-4506-8cde-2b62649a71e0 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.601613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34858-41dc-4506-8cde-2b62649a71e0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.601884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34858-41dc-4506-8cde-2b62649a71e0 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.603125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 417/813] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:07.603810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34858-41dc-4506-8cde-2b62649a71e0 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.640524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578904-af39-4bbd-9310-12804459e4a9 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.672694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.673455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.673738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.674007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.674771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:07.675096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.677004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.684608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 397/814] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:07.685358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.720736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34858-41dc-4506-8cde-2b62649a71e0 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.757171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.758037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.758311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.758578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.765329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.766787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-06a779f9-c487-4751-85ad-439150bdf41e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:07.780075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:07.781070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:07.782253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:07.786650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 418/815] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:07.787941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.788224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.788498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.791915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae447a-b673-48b1-9001-99db5fdc599d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:07.805322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:07.806553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:07.825550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:07.826440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:07.826869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:07.827301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:07.828035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:07.829393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:07.870468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 419/816] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:07.871303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.930128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 398/817] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:07.930128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:07.972622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade21c-18f6-458b-a0f9-8f3a81bdd495 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.015543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.016345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.016626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.016899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.028593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.030239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:08.050079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:08.051080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:08.052051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:08.052051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:08.052051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:08.052051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:08.056397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 420/818] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:08.057408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.077773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03e8e-f165-49ab-ba5a-d31101e39cb5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.133447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.134472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.135337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.135816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.136809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:08.137120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.138575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.153642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 399/819] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:08.153642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.187995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312b07-2672-406f-aa41-fe5330667d22 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.231931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.232751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.233031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.233303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] PATH_INFO: `/v3/services/network` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.233957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.235816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:08.250705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:08.251754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:08.253059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 421/820] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:08.253881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.273829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6139-dc36-4700-ba12-7e56830c27aa None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.317661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.318378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.319328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.319705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.320752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:08.321063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.322629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.340639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 400/821] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:08.341851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.374850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f0f2d-baf5-4688-b6d3-f98bf285c93c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.409941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.411254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.411807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.412300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/d5f07d46de6e48e19f316d764d86fd4c/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.414528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=d5f07d46de6e48e19f316d764d86fd4c, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.416226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.438996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58fd3c-1844-4ae2-8182-8f3fbb784815 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.473177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.474118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.474607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.475082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.475996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] RBAC: Adding query filter params (name=network) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:08.476625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.478204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.483629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 401/823] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:08.484799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.484988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 422/823] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:08 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/d5f07d46de6e48e19f316d764d86fd4c/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:08.495688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.591281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343160-ae62-48a8-9368-fd1dca5c1c8d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.626890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.627722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.628004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.628277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.636171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.637667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:08.658865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:08.660308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:08.661868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:08.666127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 402/824] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:08.667066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.675736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ef31-5b4b-4680-8b1d-c21afa66f7e6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.715644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.716237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.716515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.716787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.717509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] RBAC: Adding query filter params (type=network) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:08.717815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.719461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.728230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 423/825] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:08.736795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:08.861487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbf89-ff51-4070-8780-f1ce96269699 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.878103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db43a-4b38-4a5f-bd58-5c28f030d377 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:08.898256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.898924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.899203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.899475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.900329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:08.900616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.902059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.914869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:08.915532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:08.915812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:08.916081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:08.917347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:08.919041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:08.920478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 403/826] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:08.927037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.017487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 424/827] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:09.049764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aa165-3e5c-4111-bffc-e959521ac9b4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.093642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.094465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.094772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.095073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.110162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.110162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:09.128200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:09.129192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:09.130187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:09.130187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:09.130187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:09.130187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:09.130187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 404/828] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:09.135305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.275816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fee40-c07f-4ced-b31a-25cb1cbdc0d0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.311935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.312984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.313468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.313940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.314902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:09.315405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.317539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.330173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 425/829] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:09.338123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.462272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5678fb-589b-4def-be9b-ad2b01b68625 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.504283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.505610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.505891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.506220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.514522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.515956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-5af72a01-4e64-421e-b9f9-480c21b5cace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:09.535309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:09.536289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:09.537220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:09.541211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 405/830] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:09.544793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.580320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f513-511a-46f1-9106-aea833ca1b7b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.580592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f513-511a-46f1-9106-aea833ca1b7b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.580865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f513-511a-46f1-9106-aea833ca1b7b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.582562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 406/831] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:09.587325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.587602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.587881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.606248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:09.607843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:09.663516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253feb-93fe-41f4-8ab3-8180627c6275 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.691623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 407/832] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:09.709064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.709970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.710528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.710980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.712169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:09.712485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.713313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.713991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.731099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 426/833] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:09.732359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.834634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e52e-cde4-4aa2-9b1c-20cf8a5d0fb4 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.836634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936748-4771-46ed-8943-9e1d79821702 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:09.869303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.870317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.870587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.870931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/508b8f3b14414a3098cb79eaf0721e75/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.878451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:09.880036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:09.880935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:09.881387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:09.882526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.884586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.887025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=508b8f3b14414a3098cb79eaf0721e75, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:09.888597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:09.899645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:09.904034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:09.904962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 408/834] 10.222.0.26 () {56 vars in 1132 bytes} [Thu May 5 13:35:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:09.907194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:09.976306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 427/835] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:09 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/508b8f3b14414a3098cb79eaf0721e75/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:10.024078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee960e-0b9c-4253-a6d2-ef4032fa9599 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:10.062481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:10.063151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.063426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.063697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.064453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:10.064765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:10.066362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53db48-2bde-4c92-a818-0de7d19daafd None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:10.073112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 409/836] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:10.078930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:10.191423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2419-3245-4790-b0eb-5f871a03d8f3 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:10.232077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:10.233054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.233338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.233608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.234368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:10.234676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:10.236039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c66e2b-ff1b-4c06-8ff0-add0df7ec73b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:10.241602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 428/837] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:10.381707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034e10-a40d-41f1-a6af-751910263734 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.381968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034e10-a40d-41f1-a6af-751910263734 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.382234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034e10-a40d-41f1-a6af-751910263734 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.383900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 410/838] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:10.389405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.389681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.389954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.408008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:10.409214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:10.485941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 429/839] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:10.507817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034e10-a40d-41f1-a6af-751910263734 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:10.608561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034e10-a40d-41f1-a6af-751910263734 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:10.641930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:10.642672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.642949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.643218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.643925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:10.645906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:10.657685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:10.658760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:10.659606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 411/840] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:10.665041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:10.764550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c04e-dc0f-4325-ba5f-e70a5b609c29 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:10.798972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:10.799634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.799911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.800185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.800885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:10.801242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:10.803221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e5e69-6914-4cee-a020-e93bf4ecf443 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:10.808050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 430/841] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:10.813643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:10.921004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef8b93-f2bb-4aaa-8c9a-465b78e82e8f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:10.955972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:10.956643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:10.956920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:10.957190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:10.958540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:10.958845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:10.960307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14af63-d02e-446b-b01b-ea0bdee8a958 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:10.966037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 412/842] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:11.173588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287331ff-c591-4d24-a464-b2f086cb6336 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.174260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287331ff-c591-4d24-a464-b2f086cb6336 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.174260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287331ff-c591-4d24-a464-b2f086cb6336 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.175683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 431/843] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:11.180975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.181269 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.181541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.199366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:11.200559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:11.271756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 413/844] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:11.294744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287331ff-c591-4d24-a464-b2f086cb6336 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:11.399337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287331ff-c591-4d24-a464-b2f086cb6336 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:11.438417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:11.439130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.439405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.439973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.460269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:11.470330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:11.472463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:11.475053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 432/845] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:11.482041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:11.576821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcd476-837d-43d7-b0ab-f54da8738e56 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:11.611139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:11.611801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.612080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.612351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.613097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:11.613397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:11.614882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:11.623344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 414/846] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:11.628756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:11.728414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb35ecc-e307-444b-b328-af3d1bfb5044 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:11.761851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:11.762989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.763467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.763914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.775690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:11.777483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:11.796719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:11.797709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:11.798684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:11.798684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:11.798684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:11.798684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:11.798684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 433/847] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:11.804831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:11.907698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bd268-8873-4753-9725-7c18d569f28d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:11.943162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:11.944864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:11.945409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:11.945907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:11.946855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:11.947354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:11.948908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:11.966452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 415/848] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:11.968094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.071318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057183e-5ace-4a38-9d30-d8c69ca24042 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.114257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.115325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.115829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.116314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.124647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:12.126386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:12.141878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:12.142966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 13:35:12.143969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:12.147437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 434/849] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:12.153414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.262002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632020-f7a7-4899-b140-6b03420b6dba None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.296532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.297622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.298164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.298638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.299671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:12.300173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:12.302370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01734-cd7d-4e8f-8d4e-d77a6cf5d3e8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:12.321054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 416/850] 10.222.0.26 () {56 vars in 1135 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:12.326943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.416018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06cd0-6346-47cb-bae9-2b06fab75b86 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.416352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06cd0-6346-47cb-bae9-2b06fab75b86 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.416573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06cd0-6346-47cb-bae9-2b06fab75b86 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.418384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 417/851] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:12.423547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.423832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.424106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.438085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6132-3fb8-4b22-b903-b25257bc7976 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.441056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:12.442598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:12.473606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.474276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.474653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.474841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.522832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 418/852] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:12.545547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.554842 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:12.556585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532b04-3699-4a7e-86a9-a7b5520ba778 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:12.643501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0a25c-8e3f-427b-87ed-e7432d278534 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.658691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 435/853] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:12.660264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584181d4-9341-4015-a762-d2102dd69f9c None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.660729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584181d4-9341-4015-a762-d2102dd69f9c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.661179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584181d4-9341-4015-a762-d2102dd69f9c None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.662698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 436/854] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:12.663610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584181d4-9341-4015-a762-d2102dd69f9c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.679089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.679877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.680156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.680426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.690330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9d9ee640-007f-4ea2-a2a0-a7263366d898 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:12.698701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:12.699850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:12.700853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 419/855] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:12.705760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.706063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.706342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.722602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:12.724400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:12.771793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584181d4-9341-4015-a762-d2102dd69f9c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.789328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 420/856] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:12.789989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.819915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.820712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.821037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.821310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.834809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:12.836260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:12.853610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:12.854600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:12.855527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:12.855527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:12.855527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:12.855527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:12.855527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 437/857] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:12.855811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.897510 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60358bb0-e97c-413a-878e-63754e7df8e8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:12.930751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:12.931412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:12.931680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:12.931952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:12.932698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:12.932999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:12.934396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:12.951851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 421/858] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:12.951851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:12.973753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee9db-5f8c-46df-b289-20f4946045c5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.006497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.007158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.007436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.007707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.008421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.009770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.048724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555847d-748f-4ee8-a907-154f3250edd7 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.081196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.081845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.082154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.082456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.083173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:13.083474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.084859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.099224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 422/859] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:13.099224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.200207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819a2cf-cde4-4ee3-9001-407915267fce None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.231844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.232620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.232895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.233161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.243443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.244863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:13.262285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:13.263483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 423/860] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:13.269228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.273600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 438/861] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:12 2022] POST /identity/v3/services => generated 269 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:13.282210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.376680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859989ba-be90-4765-8b7f-fcd42724017c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.394734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7574-88a3-4233-ab5a-1219b6be144f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.414533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.415345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.415624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.415895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.424186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.425659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.430559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.431239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.431522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.431822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.432536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:13.432841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.434262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e2e7c-fb03-4122-8a7a-06cddbef93bc None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-76640d9a-43e0-4057-b9c3-9d7630090b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:13.440072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:13.441238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:13.442759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 424/862] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:13.443368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076a91-987b-4fdd-ae97-f0e77b835ab5 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.443450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076a91-987b-4fdd-ae97-f0e77b835ab5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.444918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076a91-987b-4fdd-ae97-f0e77b835ab5 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.445443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 425/863] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:13.450181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77076a91-987b-4fdd-ae97-f0e77b835ab5 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.453386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 439/864] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:13.454277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.454570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.454870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.473644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:13.474918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:13.549504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 440/865] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:13 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:13.550643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.557061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77076a91-987b-4fdd-ae97-f0e77b835ab5 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.592573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.593698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.594228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.594723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.596216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:13.596773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.599484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.618554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 426/866] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:13.619304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.652245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07df9-2e27-4331-8fe7-ef72a8ec707f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.686201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.687002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.687278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.687543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.694873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.696307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:13.711059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:13.712124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:13.713107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:13.716847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 441/867] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:13.717656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.724308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eda97e-0813-487f-b2ec-433c6851edcd None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.757008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.757654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.757929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.758228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.758934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.760278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.811934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec28e-7dba-4472-aa13-a9753511b2a7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:13.844320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:13.846610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:13.846610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:13.846610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:13.846610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=d5f07d46de6e48e19f316d764d86fd4c) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:13.846610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:13.848542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:13.854073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 442/868] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/role_assignments?user.id=d5f07d46de6e48e19f316d764d86fd4c&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:13.854873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:13.878199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 427/869] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:13 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:13.991813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37293af6-3568-48ce-a1c0-91c4c258ae5e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:14.038394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:14.039426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:14.039902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:14.040362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:14.041593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:14.042154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:14.047574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:14.064823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 443/870] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:14.071283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:14.183600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65216c6-80a6-4b8d-ae55-9f2b98ec17ce None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:14.217886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:14.218572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:14.218849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:14.219112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:14.287331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:14.288703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:14.388197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 428/871] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:14.393703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:14.494399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d848f4-df39-4b8b-b50a-071087b98247 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:14.529488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:14.530590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:14.531076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:14.531563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:14.541844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:14.543511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:14.561732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:14.562667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:14.563591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:14.563591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:14.563591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:14.563591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:14.565779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 444/872] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:14.575114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:14.672786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f3a9-b075-4024-85dc-ecb7be3b847e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:14.708199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:14.708858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:14.709137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:14.709408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:14.710153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:14.710456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:14.711817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:14.723445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 429/873] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:14.728911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:14.842971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410bee3-47ff-43fd-8ab8-c26b65dae868 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:14.876641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:14.877423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:14.877696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:14.877962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:14.884690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:14.886140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:14.900178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:14.901115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:14.902054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 445/874] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:14.908850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:15.013156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9333-0d52-43dc-9d5e-d1e1d5930916 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:15.048220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:15.049300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:15.049785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:15.050315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:15.051337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:15.051840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:15.053471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144437a-bb8e-45d0-899a-60f7532033ea None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:15.068286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 430/875] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:15.075019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:15.185378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b24e-6ff1-458d-8d63-e7d680008a31 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:15.219575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:15.220229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:15.220509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:15.220783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:15.221612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=508b8f3b14414a3098cb79eaf0721e75) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:15.221918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:15.223422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354bff-bf8f-4eef-ae1f-1620eb93573b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:15.229687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 446/876] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:15 2022] GET /identity/v3/role_assignments?user.id=508b8f3b14414a3098cb79eaf0721e75&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:15.587075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6639d-c87b-4d83-8e94-6b8f222b8515 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:15.587580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6639d-c87b-4d83-8e94-6b8f222b8515 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:15.587658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6639d-c87b-4d83-8e94-6b8f222b8515 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:15.589216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 431/877] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:15.594611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:15.595022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:15.595202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:15.615326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:15.616518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:15.685322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 447/878] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:15.708959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6639d-c87b-4d83-8e94-6b8f222b8515 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:15.815830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6639d-c87b-4d83-8e94-6b8f222b8515 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:15.850919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:15.851711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:15.851991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:15.852262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:15.852966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:15.854363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:15.866923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:15.868941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:15.869898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 432/879] 10.222.0.26 () {56 vars in 1132 bytes} [Thu May 5 13:35:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:15.874118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:15.974631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5588-501b-43c0-89ab-71a0e446c40f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.008937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.009613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.009896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.010209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.010929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.011236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.012619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.018045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 448/880] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:16.027096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.134195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd92bb0-a163-40a1-875a-39ecabef979e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.171455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.172123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.172401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.172670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.173377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.173675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.175121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c555-a810-4fcf-a0da-91dac4e9024f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.180935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 433/881] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:16.186442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.241238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3227a-5d8d-46ee-ad89-3ad3569eeff8 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.241597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3227a-5d8d-46ee-ad89-3ad3569eeff8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.241789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3227a-5d8d-46ee-ad89-3ad3569eeff8 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.243457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 434/882] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:16.248402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d4ba-17e3-45f2-bc98-ba1ccfaeb755 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.248690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d4ba-17e3-45f2-bc98-ba1ccfaeb755 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.248972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d4ba-17e3-45f2-bc98-ba1ccfaeb755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.266265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-63e0d4ba-17e3-45f2-bc98-ba1ccfaeb755 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:16.267450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-63e0d4ba-17e3-45f2-bc98-ba1ccfaeb755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:16.289384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d35a6-bcd8-4a31-9f87-c570cfa3e826 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.326710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.327362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.327779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.327942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.328694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] RBAC: Adding query filter params (interface=public, service_id=a7f7b9f8fe194ec185115afba793dea5, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.328989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.330387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426b7e-3ced-452d-8063-80733d5ff23a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.336309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 449/883] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/endpoints?service_id=a7f7b9f8fe194ec185115afba793dea5&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:16.341910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b939-1053-4fe8-8e45-210a7d9dccfe None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.342224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b939-1053-4fe8-8e45-210a7d9dccfe None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.342700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b939-1053-4fe8-8e45-210a7d9dccfe None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.343878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 450/884] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:16.344444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5b939-1053-4fe8-8e45-210a7d9dccfe None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.351102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 435/885] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:16.352776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.353290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.353763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.377876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:16.379337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:16.454224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 436/886] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:16.454447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5b939-1053-4fe8-8e45-210a7d9dccfe None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.454543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.491852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.492526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.492810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.493086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.493775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.495190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.501346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 451/887] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:35:16.502257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.581971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080237f-7b72-4138-bdd1-47decfe821b2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.612623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0562fa-ea22-4ff6-bcd2-9ab2bac6ded1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.620008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.621543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.622075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.622556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.623427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.625057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:16.638570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:16.639682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:16.640573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:16.643766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 437/888] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:16.650797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.654626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.655527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.656637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.656637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.656814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.658322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:16.671261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:16.672441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:16.673347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:16.677759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 452/889] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:16.679144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.774839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8503-bbb3-4684-ae38-d3b98aca1caa None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.802662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593715-86bf-469c-bc37-a4c00e184078 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.809315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.810100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.810452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.810793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.811565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.811934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.813353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.823727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 438/890] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:16.825082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.850070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.850070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.850070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.850070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.850494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.850494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.851144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.861328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 453/891] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:16.862825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:16.934442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c8e2-daf4-48d4-8acd-df88816611a3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.963768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc040-bb2e-482e-8f84-f6b1e628ded2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:16.970420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:16.971083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:16.971362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:16.972024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:16.972756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:16.973117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:16.974889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:16.982044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 439/892] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:17.014901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:17.015583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.015864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.016135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.016864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:17.017169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:17.018783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:17.030276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 454/893] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:17.031707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:17.153602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b77f4-d943-4749-86e3-aefedc586bb1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:17.188691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:17.189279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.189626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.189906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.190865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] RBAC: Adding query filter params (interface=public, service_id=c1c9704b48a34e9e85c43d3f539139ed, region_id=RegionOne) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:17.191178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:17.193125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9372b3-8929-4bbc-9012-ee439d063d19 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:17.200055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 440/894] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:17 2022] GET /identity/v3/endpoints?service_id=c1c9704b48a34e9e85c43d3f539139ed&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:17.205794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:17.309435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf97fd-7c91-44cb-ae36-8245a43215d0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:17.344951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:17.345617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.345929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.346210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.346881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:17.348788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e32a1-df59-4388-ae29-62fcfb29c5b8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:17.355450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 455/895] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:17 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:35:17.655504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13191d8-fafc-4932-ad58-80355b0d2002 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.656044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13191d8-fafc-4932-ad58-80355b0d2002 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.656044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13191d8-fafc-4932-ad58-80355b0d2002 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.657671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 441/896] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:17.663384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.663813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.664000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.680999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:17.682239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:17.755947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 456/897] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:17.779457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13191d8-fafc-4932-ad58-80355b0d2002 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:17.880594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13191d8-fafc-4932-ad58-80355b0d2002 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:17.914221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:17.915352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:17.915851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:17.916342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:17.927850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:17.936046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:17.937019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:17.937949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:17.940675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 442/898] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:17.947025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.048832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c529-da33-465c-8834-3a875ee2ef80 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.088566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.089613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.090133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.090612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.091607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:18.092114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:18.093708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:18.103688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 457/899] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:18.109254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.213198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21eb0-45e4-4cea-8c49-91ad0f49e096 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.247632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.248421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.248694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.248963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.259212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:18.260630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:18.277932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:18.278896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:18.280471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:18.280471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:18.280471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:18.280471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:18.280471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 443/900] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:18.290956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.391519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08083e3e-fd78-4bff-802a-0d40c8c65822 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.436729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.437671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.438130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.438548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.439417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:18.439862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:18.441394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:18.454410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 458/901] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:18.460241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.565822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9679-b570-4b87-9fee-0235b1d00cc3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.599810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.600613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.600889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.601158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.608674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:18.610115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:18.624395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:18.625366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:18.626849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 444/902] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:18.631261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.731780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc908721-6f71-46e2-8afe-e0be7862d8c5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.769386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.770537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.771026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.771501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.772574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:18.773139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:18.774863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc846c-a5ee-46dc-a2ad-b36981c48e7f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:18.794883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 459/903] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:18.800155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:18.901929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07823d0-7bef-432b-9b4d-17c36dd66821 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:18.935811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:18.936516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.936797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.937076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.953068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdf13-83f2-4cd1-b63b-499574e9d1a9 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.953659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdf13-83f2-4cd1-b63b-499574e9d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.954186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdf13-83f2-4cd1-b63b-499574e9d1a9 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.955754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 460/904] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:18.961617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:18.962037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:18.962430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:18.979622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:18.980933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:19.013167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.014968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.054437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 461/905] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:19.073351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.118923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 445/906] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:19.124493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.179661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c77fb-1bb0-4a28-857b-7428e93dbe82 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.216368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.217530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.218053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.218541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.219405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.221024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.230980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801058-65ff-4d83-9fdd-1497f9528de1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:19.233848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:19.234831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 13:35:19.235712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:19.243780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 462/907] 10.222.0.26 () {56 vars in 1132 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:19.245214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.268663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.270337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.270664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.270941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.281230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.283181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:19.300551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:19.302279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:19.303418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:19.303418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:19.303418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:19.303418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:19.309308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 446/908] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:19.310364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.353256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c281a-5c44-4cc9-9f4f-ac5ff79bc662 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.389268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.390266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.390555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.390828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.391698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:19.392005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.394070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f99ec-d9f1-443b-97ae-06ae3b15d254 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.404775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 463/909] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:19.404775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808699-849b-4b1a-ba2a-44fb1086158c None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.404775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808699-849b-4b1a-ba2a-44fb1086158c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.404775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808699-849b-4b1a-ba2a-44fb1086158c None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.405322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 464/910] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:19.406872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808699-849b-4b1a-ba2a-44fb1086158c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.413295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed7b1c-61b9-45fd-bfaa-a97533e06508 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.449965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.450576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.450855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.451136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.451858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:19.452167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.453517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81887-934a-475c-adb0-cb7cd8970b37 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.471064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 447/911] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:19.472398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.472688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.472999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.489171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:19.490366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:19.509111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808699-849b-4b1a-ba2a-44fb1086158c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.544830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.545485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.545763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.546050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.546747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:19.547087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.548440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.553038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 465/912] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:19.553804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.565552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 448/913] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:19.567426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.652713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0ad18-1154-4004-9808-87bb116fa514 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.681104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40dc9-8b07-459c-a8a7-b5d3cd4b4a57 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.689702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.690532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.690811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.691080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.698761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.700256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:19.713849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:19.714826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:19.715757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 466/914] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:19.716265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.719611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.720292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.720566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.720832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.721560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.723484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dec5d0-884b-4f47-a8b8-449c2462aacf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.809558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f35e-4762-47af-b096-b5889cd5f33c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.810242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 449/915] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:19.810873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b609d-bf2e-4b61-a45a-c9ec78fec825 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.811159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b609d-bf2e-4b61-a45a-c9ec78fec825 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.811428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b609d-bf2e-4b61-a45a-c9ec78fec825 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.812883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 450/916] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:19.814874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b609d-bf2e-4b61-a45a-c9ec78fec825 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:19.853980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.854994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.855275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.855551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.856275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.857663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adb3ed-e66e-4096-ad13-e3c781e43b00 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.928147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b609d-bf2e-4b61-a45a-c9ec78fec825 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:19.936661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 467/917] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:19 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:19.940234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.940234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.940234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.968998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:19.970817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:19.976770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:19.977452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:19.977726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:19.977994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:19.978903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:19.979206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:19.980709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:19.998055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 451/918] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:20.004788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:20.058193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 468/919] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:20.085213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:20.117195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573a05-87df-4f7d-97ac-c8d4064725d5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:20.153173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:20.153830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:20.154142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:20.154410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:20.155232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] RBAC: Adding query filter params (role.id=7b0474cad3d2491fbf5c8020cf0d71fc, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=508b8f3b14414a3098cb79eaf0721e75) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:20.155532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:20.156952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:20.162911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 452/920] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:20 2022] GET /identity/v3/role_assignments?user.id=508b8f3b14414a3098cb79eaf0721e75&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=7b0474cad3d2491fbf5c8020cf0d71fc => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:20.204939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c524d-b5fe-4a5d-a601-48fdf48d980b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:20.242632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:20.243361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:20.243640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:20.243907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:20.244570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:20.246004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:20.259376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:20.260491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:20.261398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 469/921] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:20.267087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:20.373156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dc9e-ef88-464b-9a3d-0f299bf765e3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:20.407952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:20.408949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:20.409431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:20.409901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:20.410901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:20.411405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:20.413047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:20.418279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 453/922] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:20.426071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:20.522896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca17c-4e06-47fe-a473-10aae7107dfa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:20.556718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:20.557373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:20.557650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:20.557920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:20.558650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:20.558947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:20.560300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee104f3-47e4-47a5-bb37-515d9ab5b37f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:20.565376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 470/923] 10.222.0.26 () {56 vars in 1114 bytes} [Thu May 5 13:35:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:20.571227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:20.680303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b270-892e-44ed-bc1a-6eaeec35559e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:20.715120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:20.715781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:20.716062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:20.716397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:20.717255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:20.718703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadaee3-f630-4a57-af2c-392775d8b4ba None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:20.828757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 454/924] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:22.196613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c22-54eb-4f8b-9b91-76045a6fa35f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.197236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c22-54eb-4f8b-9b91-76045a6fa35f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.197236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c22-54eb-4f8b-9b91-76045a6fa35f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.198842 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 471/925] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:22.203911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.204743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.205269 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.223480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:22.224952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:22.285098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7d3-bd1b-472e-94f0-f4f52458683a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.286321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7d3-bd1b-472e-94f0-f4f52458683a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.286829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7d3-bd1b-472e-94f0-f4f52458683a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.292575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 472/926] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:22.294658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.295181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.295654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.306066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 455/927] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:22.313137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:22.314545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:22.327417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.398200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 473/928] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:22.422508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.433555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab1daf-776e-47e9-8f5d-51e427684e03 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.469448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.470274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.470554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.470826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.471484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.472877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-bec8bcf1-7245-40e3-a933-f94170a15589 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:22.484487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:22.485706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:22.486623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 456/929] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:22.487443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876b42-7152-4e9d-98a1-4de76c0b90f1 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.487443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876b42-7152-4e9d-98a1-4de76c0b90f1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.487443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876b42-7152-4e9d-98a1-4de76c0b90f1 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.488832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 457/930] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:22.491661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876b42-7152-4e9d-98a1-4de76c0b90f1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.535319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e4467-5f17-4bd1-b160-cef585c0ec54 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.568877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.569935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.570232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.570506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.571165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.572533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-ed13be7b-191d-490a-833d-4d7d685f50c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:22.584935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:22.585993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:22.586877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 474/931] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:22.588201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.588201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.588201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.599242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876b42-7152-4e9d-98a1-4de76c0b90f1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.604743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:22.605923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:22.632691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020628e-678a-43a7-910e-986daec455cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.633404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020628e-678a-43a7-910e-986daec455cf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.633685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020628e-678a-43a7-910e-986daec455cf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.633944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020628e-678a-43a7-910e-986daec455cf None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.634693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020628e-678a-43a7-910e-986daec455cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:22.634993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020628e-678a-43a7-910e-986daec455cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.636345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020628e-678a-43a7-910e-986daec455cf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.645892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 458/932] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:22.645892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020628e-678a-43a7-910e-986daec455cf None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.671065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 475/933] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:22.672238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.756629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020628e-678a-43a7-910e-986daec455cf None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.768086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0740b-2b43-43a8-9733-15fbb0bc5439 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.793967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.794677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.794933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.795204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.795912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:22.796217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.797572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.802836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 459/934] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:22.803606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.812003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.812673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.812952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.813222 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.813935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:22.814258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.815625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.820925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 476/935] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:22.821757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:22.935649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b475c-a1e4-4ab5-8f91-65c4c9ff066d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.945453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496370-fe39-484a-a424-4053a562c1e1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:22.975894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.977092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.977561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.978039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.983565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:22.984219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:22.984461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:22.984742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:22.985466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:22.985771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:22.987216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:22.992305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:22.998024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 477/936] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:22.999452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:23.001711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:23.002726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:23.003694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:23.011561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 460/937] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:23.012672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.129367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0e09-940a-4b6a-993a-2982285f0397 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.147607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6290a07-5c26-4490-a2e8-ec1bf213437e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.170203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.171000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.171325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.171598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.172394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] RBAC: Adding query filter params (interface=public, service_id=0ef70fb8e3904baf991704a1ac67fcea, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:23.172703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.174111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513eddf2-d31e-4f36-8d30-30bc0d129972 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.179546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 478/938] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:22 2022] GET /identity/v3/endpoints?service_id=0ef70fb8e3904baf991704a1ac67fcea&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:23.180817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a55-973e-4662-b509-b55df4589682 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.181078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a55-973e-4662-b509-b55df4589682 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.181350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a55-973e-4662-b509-b55df4589682 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.182869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 479/939] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:23.187131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6020a55-973e-4662-b509-b55df4589682 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.189776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.190668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.191130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.191936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.192701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:23.193792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.194666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409ccd-fbf7-4fdd-83ec-a41d40cfeccd None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.204171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 461/940] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:23.206266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91550-ea3d-4030-8549-3813f292508b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.206766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91550-ea3d-4030-8549-3813f292508b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.207862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91550-ea3d-4030-8549-3813f292508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.224356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-33a91550-ea3d-4030-8549-3813f292508b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:23.225612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-33a91550-ea3d-4030-8549-3813f292508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:23.290508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6020a55-973e-4662-b509-b55df4589682 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.294925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 462/941] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:23.295567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91550-ea3d-4030-8549-3813f292508b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.334437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.335098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.335426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.335703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.336381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.337748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.344163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 480/942] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:35:23.350662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.403773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91550-ea3d-4030-8549-3813f292508b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.443522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.444693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.445636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.446053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.459678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.461458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:23.482490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:23.483478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:23.484410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:23.484410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:23.484410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:23.484410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:23.490053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2ee1-a565-458b-953d-d7e4705368d5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.490724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 463/943] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:23.493415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.533413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.534579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.535069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.536413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.537322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.539012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.541006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING keystone.server.flask.common [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 13:35:23.609413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.sql.core [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 13:35:23.609413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 13:35:23.609413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [parameters: {'id': 'f614abaa587141638c30d96c185cfa8a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 13:35:23.609413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86654) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 13:35:23.615557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af7561-e470-4318-828f-3d031de9e1a1 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f614abaa587141638c30d96c185cfa8a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f614abaa587141638c30d96c185cfa8a. May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application conn.query(q) May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:35:23.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application result.read() May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 05 13:35:23.632395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return project_ref.to_dict() May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application next(self.gen) May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application yield resource May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application next(self.gen) May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.session.rollback() May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.force_reraise() May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise self.value May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application session.commit() May 05 13:35:23.633951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._prepare_impl() May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.session.flush() May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._flush(objects) May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application compat.raise_( May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application flush_context.execute() May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 13:35:23.636035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rec.execute(self) May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 13:35:23.637149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application conn.query(q) May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application result.read() May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:35:23.639278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [parameters: {'id': 'f614abaa587141638c30d96c185cfa8a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.641667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:23.644413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.Conflict( May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f614abaa587141638c30d96c185cfa8a. May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.647100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 481/944] 10.222.0.26 () {60 vars in 1140 bytes} [Thu May 5 13:35:23 2022] POST /identity/v3/projects => generated 262 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:23.654412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.660903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.661517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.661944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.662384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.663283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:23.663688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.665281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.679430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 464/945] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:23.684556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.793300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faa50a-305f-4fac-a0b9-5d2fa91a8f68 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.798452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0808-1164-40bb-86c0-707421bc3134 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.834214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.835115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.835488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.835834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.836881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:23.838069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:23.839013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:23.839496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:23.843880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.845401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.848196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:23.850506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:23.860776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:23.861766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:23.862794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:23.866586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 465/946] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:23.868149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:23.869097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:23.869987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:23.870944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:23.874194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 482/947] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:23.882641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:23.981251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85578c-2544-4258-a79b-0e361976d42e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:23.996724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3b94-79f7-4ff9-80b4-3ed41a921af2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.021089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.021820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.022332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.022442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.023128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:24.023427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.025062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.042260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.043279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.043836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.044325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.045399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:24.045921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.047571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.051349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 483/948] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:24.069607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 466/949] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:24.075752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:24.201747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee52d0-600c-472d-93d4-101987bde01a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.237112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.238897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.239376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.239649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.250736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.252208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:24.269606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:24.270612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:24.271522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:24.271522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:24.271522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:24.271522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:24.271522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 484/950] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:24.276843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:24.376466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68373181-301b-42ad-85dc-b8a3b80cb0b8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.410111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.411313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.411594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.411867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.412592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:24.412894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.414278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.426197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 467/951] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:24.431368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:24.544826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9f381-b92e-401d-abae-4333c245c0f6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.578666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.579814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.580293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.580793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.588401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.590142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:24.604935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:24.605843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:24.607135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:24.609603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 485/952] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:24.615171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:24.718465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859712ac-6a0b-4ff3-b4db-28373756cd05 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.751613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.752280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.752564 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.752839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.753625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:24.754488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.755924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86cfc-77b9-4616-b701-6819b450884a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:24.768725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 468/953] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:24.775149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:24.875338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cd178-93c5-415d-a392-d57e3fa0286b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:24.910780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:24.912032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:24.912539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:24.913033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/508b8f3b14414a3098cb79eaf0721e75/roles/7b0474cad3d2491fbf5c8020cf0d71fc` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:24.915613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=508b8f3b14414a3098cb79eaf0721e75, role_id=7b0474cad3d2491fbf5c8020cf0d71fc)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:24.917297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52373c-47f1-40e8-beac-e3ae6552382a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:25.085860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 486/954] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:24 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/508b8f3b14414a3098cb79eaf0721e75/roles/7b0474cad3d2491fbf5c8020cf0d71fc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:25.198562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b801-2cc7-4c18-a557-0e727db579b9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.198907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b801-2cc7-4c18-a557-0e727db579b9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.199121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b801-2cc7-4c18-a557-0e727db579b9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.200782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 469/955] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:25.206714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5590e-e4ae-40dd-ad48-e5f94f656015 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.207588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5590e-e4ae-40dd-ad48-e5f94f656015 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.207819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5590e-e4ae-40dd-ad48-e5f94f656015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.226043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-01f5590e-e4ae-40dd-ad48-e5f94f656015 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:25.227604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-01f5590e-e4ae-40dd-ad48-e5f94f656015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:25.301021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 487/956] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:25.323834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b801-2cc7-4c18-a557-0e727db579b9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:25.427597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b801-2cc7-4c18-a557-0e727db579b9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:25.462574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:25.463266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.463553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.463829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.464690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:25.466056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23017ee-d1b1-4e82-999f-45008f9ed9d0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:25.537637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 470/957] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:25 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:25.661955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3f71-1617-4f17-93be-b6af4d92ecf3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.662796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3f71-1617-4f17-93be-b6af4d92ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.662796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3f71-1617-4f17-93be-b6af4d92ecf3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.664183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 488/958] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:25.670125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.670462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.670695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.689351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:25.690572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:25.774172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 471/959] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:25.797051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3f71-1617-4f17-93be-b6af4d92ecf3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:25.900124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3f71-1617-4f17-93be-b6af4d92ecf3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:25.934294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:25.935094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:25.935368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:25.935634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:25.936285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:25.937637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:25.950305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:25.951446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:25.952435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 489/960] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:25.959177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:26.059211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c21ac-dd6f-43ed-97c0-70351a126961 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:26.092825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:26.096498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.096498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.096498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.096498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:26.096498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:26.096884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:26.109131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 472/961] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:26.115780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:26.216208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628001ee-2758-4b14-9684-8d3ebb82c9d8 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:26.254747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:26.255424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.255701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.255969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.256683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:26.256983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:26.258442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f71f41-8666-4fbd-8e4e-06e9b61af3a0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:26.264611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 490/962] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:26.270770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:26.377057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85adb53-bb1d-4e22-82b8-c7eb4d6fb2b5 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:26.412845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:26.413866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.414383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.414879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.415869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:26.417440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:26.456527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee832b3-b3ee-467e-b428-b5ec611af780 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.456834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee832b3-b3ee-467e-b428-b5ec611af780 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.457620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee832b3-b3ee-467e-b428-b5ec611af780 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.459040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 491/963] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:26.463911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.464258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.464608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.481111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:26.482230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:26.509881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 473/964] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:26.572614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 492/965] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:26.599057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:26.714004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8d2e7-1071-4f51-8f5c-cb4d1e32bbed None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:26.750411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:26.751004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.751280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.751549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.752260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:26.753700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:26.755145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING keystone.server.flask.common [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 13:35:26.798637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.sql.core [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 13:35:26.798637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 13:35:26.798637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [parameters: {'user_id': 'bc931a95100640e6a448c1d6beaa836f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 13:35:26.798637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86653) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application conn.query(q) May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result.read() May 05 13:35:26.806410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:35:26.807308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application next(self.gen) May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application yield resource May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application next(self.gen) May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.session.rollback() May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.force_reraise() May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise self.value May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application session.commit() May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 13:35:26.808316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._prepare_impl() May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.session.flush() May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._flush(objects) May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application compat.raise_( May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application flush_context.execute() May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rec.execute(self) May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 13:35:26.809268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result = connection._execute_20( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 13:35:26.811069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result = self._query(query) May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application conn.query(q) May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application result.read() May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 13:35:26.813088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bc931a95100640e6a448c1d6beaa836f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:26.819557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 05 13:35:26.821602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:26.823764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 474/966] 10.222.0.26 () {60 vars in 1131 bytes} [Thu May 5 13:35:26 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:26.828828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:26.935878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53411a9f-2683-48c9-92f1-ec1acbefa4f2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:26.971258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:26.972421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:26.973428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:26.973907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:26.981208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:26.982902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a58f6a0a-2a82-4917-aace-9d86c8ad8d72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:26.997878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:27.006040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:27.007144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 493/967] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:27.007777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:27.111806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4060-0034-4277-8a56-e8332fae9b6b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:27.145842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:27.146535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.146811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.147082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.147880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:27.148178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:27.149791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc32a5-bbeb-4f18-adac-e3e0d455ed2b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:27.188451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 475/968] 10.222.0.26 () {56 vars in 1101 bytes} [Thu May 5 13:35:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:27.455096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c4dd-fc60-4767-aec1-2405e9c97a4a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.455451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c4dd-fc60-4767-aec1-2405e9c97a4a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.455646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c4dd-fc60-4767-aec1-2405e9c97a4a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.457726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 494/969] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:27.463210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.463680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.463768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.481171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:27.482727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:27.546964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 476/970] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:27.571329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c4dd-fc60-4767-aec1-2405e9c97a4a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:27.666673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c4dd-fc60-4767-aec1-2405e9c97a4a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:27.703464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:27.704271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.704548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.704817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.714694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:27.723480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:27.724522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:27.725390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:27.730171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 495/971] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:27.731811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:27.832276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867203-ef57-402a-af2c-0875da6cbdf9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:27.864028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:27.864672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.864946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.865212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.865945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:27.866318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:27.867696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612ed1-004c-4e82-87d7-ca10f3181e83 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:27.880316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 477/972] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:27.881960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:27.922827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e634-3766-4c3c-a665-2599b11ac1ca None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.923148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e634-3766-4c3c-a665-2599b11ac1ca None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.923376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e634-3766-4c3c-a665-2599b11ac1ca None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.924740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 478/973] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:27.929423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:27.929709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:27.929988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:27.946822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:27.947984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:27.980388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3a2b-a876-436c-837d-88b5992dd90d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.012626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 479/974] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:28.013620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.014464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.014731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.015002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.025476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.026953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.035688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:28.043970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:28.049408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:28.050598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:28.050598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:28.050598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:28.050598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:28.050598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 496/975] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:28.052068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.142084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676a507-30c6-4db6-b58b-234814e21a52 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.157471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae777-3a0c-4dc5-8f66-6d28c2a73767 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.179091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.179957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.180162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.180409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.181045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.182405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.190631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.191398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.191877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.192326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.193436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:28.193612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:28.195030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:28.200901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:28.201681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.201766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 480/976] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:28.201839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.201919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.212754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 497/977] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:28.213663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.307194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e6329-ffbf-4108-b91c-e655b34cf34a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.318841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f476-677a-43f8-9c1f-c81a47d11a22 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.340657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.341318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.341597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.341868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.342601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:28.342901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.344279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.349731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 481/978] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:28.353910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.354778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.355055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.355242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.355340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.362464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.363971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:28.379022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:28.379990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:28.380966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 498/979] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:28.385756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.451546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502466e5-d2a1-475e-892c-3abd5cd5cc26 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.481767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd8b-044e-425e-a266-53dcdbdb95bf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.484042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.484783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.485130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.485493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.486301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:28.486671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.488164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.493711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 482/980] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:28.499165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.517464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.518184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.518466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.518738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.519607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:28.519910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.521327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.543606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 499/981] 10.222.0.26 () {56 vars in 1149 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:28.544696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.609258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76585-8bef-43d9-8d3c-3e266109c504 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.643113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.643771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.644055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.644330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.645118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] RBAC: Adding query filter params (interface=public, service_id=4e1a8c54fb3e4bf6a746ebd78b61aac6, region_id=RegionOne) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:28.645427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.646311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774182-4114-4db3-8fc3-9f108758e06a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.646824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.656494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 483/982] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/endpoints?service_id=4e1a8c54fb3e4bf6a746ebd78b61aac6&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:28.657344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.687856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.688780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.689412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.689688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.757950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29e69-6f11-4b3f-a491-71a3624feec3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.767559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.769007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514ef60-195a-454e-b6f4-fd455c569498 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.791195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:28.791857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.792143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.792468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.793147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:28.794561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bd598-140b-4a42-b545-bc8049420670 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:28.800798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 484/983] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:35:28.871960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a5b38-c635-4af0-b3ee-271a7a42b72c None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.872266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a5b38-c635-4af0-b3ee-271a7a42b72c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.872435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a5b38-c635-4af0-b3ee-271a7a42b72c None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.877710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 500/984] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:28.877920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 485/985] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:28.878882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a5b38-c635-4af0-b3ee-271a7a42b72c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:28.879463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:28.879757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:28.880036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:28.897428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:28.898760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:28.973925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 501/986] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:28.995954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a5b38-c635-4af0-b3ee-271a7a42b72c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:28.996622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.032820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.034306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.034578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.045227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.046716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:29.064115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:29.065075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:29.066184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:29.066184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:29.066184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:29.066184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:29.066184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 486/987] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:29.071238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.102679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5e51c-5dbf-40db-ac69-27e8f7c9f3dd None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.138175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.138904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.139190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.139473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.140110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.141485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:29.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:29.155291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:29.156170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 502/988] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:29.161544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.179831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efe1df-4236-468e-bb2a-da80a7b693ea None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.213678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.214466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.214820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.215163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.215961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.216335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.217771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.229909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 487/989] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:29.235188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.263677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af88fc-ccda-4b12-847c-1b4d78075c2d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.295190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.295843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.296119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.296385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.297075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.297370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.298730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.307772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 503/990] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:29.308773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.335265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1ff-6c77-4458-90ff-a9809748fffa None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.370173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.370949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.371379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.371651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.380087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.381918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:29.396789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:29.397853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:29.403620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 488/991] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:29.404233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.412649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0beaba-a5ee-4a8c-9bdd-0b798e1be9a1 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.445502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.446189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.446475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.446748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.447454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.447755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.449119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.453836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 504/992] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:29.459485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.513919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a40e-4609-46e3-a5db-95846b83ce5f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.546578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.547234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.547559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.547849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.548628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.548934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.550394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.561868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5ae01-767f-4d53-8f92-9b377f34fc78 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.566991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 489/993] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:29.568058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.595206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.595856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.596135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.596405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.597208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] RBAC: Adding query filter params (interface=admin, service_id=0ef70fb8e3904baf991704a1ac67fcea, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.598283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.599668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.609024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 505/994] 10.222.0.26 () {56 vars in 1249 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/endpoints?service_id=0ef70fb8e3904baf991704a1ac67fcea&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:29.610153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:29.668515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d899-850c-4963-9320-6b842bbc7e31 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.702552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.703513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.703850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.704186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.705083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] RBAC: Adding query filter params (role.id=7b0474cad3d2491fbf5c8020cf0d71fc, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=508b8f3b14414a3098cb79eaf0721e75) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:29.705453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.706405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd27703-31d9-4623-a3cc-dc257ec28afb None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:29.707577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbedcf-f2c5-4e72-a785-37783c3524a8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.719566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 490/995] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/role_assignments?user.id=508b8f3b14414a3098cb79eaf0721e75&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=7b0474cad3d2491fbf5c8020cf0d71fc => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:29.748251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:29.749095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:29.749501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:29.749898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:29.750718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:29.752229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2af753-28be-4bc5-807c-b5b4a9b3f5a0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:29.760486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 506/996] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:29 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:35:31.084279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9e247-a4a2-400a-bb81-92aa7ea07095 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.084798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9e247-a4a2-400a-bb81-92aa7ea07095 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.084798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9e247-a4a2-400a-bb81-92aa7ea07095 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.086366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 491/997] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:31.091378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.091747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.091929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.109491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:31.110679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:31.174326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 507/998] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:31.198652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9e247-a4a2-400a-bb81-92aa7ea07095 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:31.295061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9e247-a4a2-400a-bb81-92aa7ea07095 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:31.327296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:31.328080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.328358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.328630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.329276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:31.330655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:31.342524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:31.343558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:31.350258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 492/999] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:31.351106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:31.442508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c33c-9bae-47ce-9aa1-f4063a9905b2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:31.475203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:31.475864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.476142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.476412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.477118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:31.477418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:31.478801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:31.488247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 508/1000] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:31.489201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:31.584965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fdc0-4512-4d58-ae80-ae7577565b1e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:31.617509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:31.618109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.618391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.618660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.619357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:31.619655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:31.621007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008f675-dc74-4d23-9826-77b17061b268 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:31.630280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 493/1001] 10.222.0.26 () {56 vars in 1112 bytes} [Thu May 5 13:35:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:31.631236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:31.726646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6bb0b-3c7e-406a-bd9c-d2e5bfd19d2e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:31.763161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:31.763820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:31.764095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:31.764364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:31.765189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:31.766587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6bfb0-7ee2-412d-b6b4-8a746138ba8b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:31.862732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 509/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:35:32.055464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d71ac-5ec9-4179-8985-774295fb3685 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.055673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d71ac-5ec9-4179-8985-774295fb3685 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.055948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d71ac-5ec9-4179-8985-774295fb3685 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.057322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 494/1003] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:32.062317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348af2-39e4-4bd2-b644-36f7cdc37f22 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.062464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.062680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348af2-39e4-4bd2-b644-36f7cdc37f22 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.062791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.062867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348af2-39e4-4bd2-b644-36f7cdc37f22 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.062938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.064220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 510/1004] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:32.070163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.071807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.071807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.081143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:32.082418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:32.087872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:32.089035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:32.162432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 495/1005] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:32.165676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 511/1006] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:32.185384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.190299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.289177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02e46-b511-42fb-aa22-cdf60b3ad6a4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.292305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cc1cc-f28c-46bd-a078-c6e8a4cb4f40 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.323309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.324017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.324295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.324567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] PATH_INFO: `/v3/services/image` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.325218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.326342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.326614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.327157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.327411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.327682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.328333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.329676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:32.338127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:32.339159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:32.340583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 496/1007] 10.222.0.26 () {56 vars in 1105 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:32.344360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:32.345375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 13:35:32.346277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:32.347042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.350155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 512/1008] 10.222.0.26 () {56 vars in 1126 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:32.351906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.446582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c1da-5979-4aab-8a32-a7fec3b18651 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.452111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a246c-73d3-485e-92a9-d831d59f4183 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.479882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.480533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.480813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.481086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.481784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] RBAC: Adding query filter params (name=image) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:32.482110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.483474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.487567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.488177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 497/1009] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:32.492796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.492796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.492796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.492796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:32.492796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.493297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.493757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.503009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 513/1010] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:32.504422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.592758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4e5c3-f3f9-43ad-8ae4-f856d8d6d6cc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.602121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207aa3-b055-435f-a00f-ea59d7bfc404 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.624848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.625502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.625789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.626088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.626793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] RBAC: Adding query filter params (type=image) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:32.627097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.628467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.633202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 498/1011] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:32.635486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.636373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.636836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.637310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.638252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:32.638743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.640339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babaff7-2046-49e4-85a6-891342da6e9f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.647066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 514/1012] 10.222.0.26 () {56 vars in 1122 bytes} [Thu May 5 13:35:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:32.653160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:32.756876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4c60-3935-431b-b7be-f487ced51e86 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:32.793950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:32.794656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:32.794936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:32.795211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:32.795964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:32.797364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affed90-006b-4cda-9f53-91a28521477e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:32.856192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 499/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:34.249359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833467-2103-42f4-b615-6ce8f9e84138 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.249871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833467-2103-42f4-b615-6ce8f9e84138 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.249871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833467-2103-42f4-b615-6ce8f9e84138 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.251540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 515/1014] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:34.257114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.257519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.257683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.275445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:34.276598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:34.348846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 500/1015] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:34.371999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20833467-2103-42f4-b615-6ce8f9e84138 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:34.469834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20833467-2103-42f4-b615-6ce8f9e84138 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:34.501902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:34.502730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.503009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.503277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.513771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:34.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:34.523352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:34.524246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:34.525528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 516/1016] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:34.529618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:34.624842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151dcf-9797-4810-97e9-c0dded1dc185 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:34.657340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:34.658000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.658305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.658576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.659318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:34.659619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:34.661009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:34.670168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 501/1017] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:34.674682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:34.773640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce3325-fd54-42fb-8658-0d218cc69011 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:34.805313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:34.806115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.806393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.806655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.817260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:34.818787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-4911cbb2-e42b-40f0-8fc6-557efb71d2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:34.835483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:34.836444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:34.837388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:34.837388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:34.837388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:34.837388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:34.837388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 517/1018] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:34.843781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:34.883323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b3a5-8074-44d1-8d50-9bf0f3c340c9 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.883638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b3a5-8074-44d1-8d50-9bf0f3c340c9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.883829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b3a5-8074-44d1-8d50-9bf0f3c340c9 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.885290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 518/1019] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:34.889992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.890309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.890584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.907126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:34.908312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:34.947412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95dda-35d4-4662-ae24-3acafca1a05e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:34.978280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 519/1020] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:34.989850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:34.990534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:34.990810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:34.991073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:34.991846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:34.992142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:34.993492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.001498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.010105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 502/1021] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:35.011237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.107776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740a932-5c72-4436-80b9-e72c3b17a7fb None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.114910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899282f-a6ed-458f-841d-613b6767638c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.142101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.142704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.142987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.143258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.143986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.145382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f5b66-e0b9-422c-acc5-363315e20ffe None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.147328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.148110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.148392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.148662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.155711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.157124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d2f49314-42a4-48ad-9f93-8308df6f75e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:35.171020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:35.172145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:35.173160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 503/1022] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:35.173774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241aab7-1d3f-4314-a4bf-0855aa23b625 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.173774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241aab7-1d3f-4314-a4bf-0855aa23b625 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.173899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241aab7-1d3f-4314-a4bf-0855aa23b625 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.175166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 504/1023] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:35.178368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241aab7-1d3f-4314-a4bf-0855aa23b625 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.267305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 520/1024] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:35 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:35.268566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.268852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.269195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.281793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241aab7-1d3f-4314-a4bf-0855aa23b625 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.287371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:35.288605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:35.319106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.320047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.320329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.320600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.321525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:35.321758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.323279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.348696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 505/1025] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:35.350042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.361568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 521/1026] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:35.385348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.451676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a744d7-c84e-4d03-9584-e50dea835f25 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.488105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.488304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8cc91-1a5d-4a05-8296-c868c236a716 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.488393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.488393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.488393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.521483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.522295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.522573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.522840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.524009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.525424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.527473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 522/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:35.532638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.554870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.556309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.627984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99add-f625-4cd5-8c7d-991863838745 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.654696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 506/1028] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:35.660094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.661764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.662453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.662722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.662994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.663698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.665121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.754959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77b6e-3475-4db2-9643-070ddeb8c04a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.781350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 523/1029] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:35:35 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:35:35.793210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.794042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.794334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.796773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.811157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.812653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:35.833261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:35.834535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:35.835505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:35.835505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:35.835505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:35.835505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:35.835505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 507/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:35.840399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:35.944903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068090f0-53de-41a9-897c-6d0d9ca13c2f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:35.981735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:35.982427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:35.982703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:35.982967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:35.983691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:35.983992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:35.985349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:35.998224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 524/1031] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:36.003656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:36.104474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14005839-54d1-4070-ba5e-d88aa0a3484f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:36.137939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:36.138751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:36.139031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:36.139299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:36.145944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:36.147403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:36.161292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:36.162251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:36.163589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 508/1032] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:36.168511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:36.263224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8fa97-e8a1-407e-bf11-46ac61b85eda None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:36.296342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:36.296975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:36.297252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:36.297517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:36.298326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:36.298626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:36.300027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30c84-2560-42b5-a315-a3d1c20b39c7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:36.311837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 525/1033] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:36.317888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:36.416787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b000b-05ca-45d2-be59-d9b3530d4c80 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:36.448863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:36.449512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:36.449790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:36.450088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:36.450908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] RBAC: Adding query filter params (role.id=7b0474cad3d2491fbf5c8020cf0d71fc, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:36.451209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:36.452617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dc51c-7d35-4f52-9152-4856657a27ee None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:36.464722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 509/1034] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:36 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=7b0474cad3d2491fbf5c8020cf0d71fc => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:37.534256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53856f0c-4cbf-4ba4-943f-5606efc94e3b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:37.535249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53856f0c-4cbf-4ba4-943f-5606efc94e3b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:37.535249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53856f0c-4cbf-4ba4-943f-5606efc94e3b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:37.536821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 526/1035] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:37.542046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:37.542541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:37.542617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:37.560554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:37.561747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:37.626044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 510/1036] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:37.649221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53856f0c-4cbf-4ba4-943f-5606efc94e3b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:37.745677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53856f0c-4cbf-4ba4-943f-5606efc94e3b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:37.778679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:37.779466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:37.779746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:37.780020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:37.780669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:37.782069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:37.794128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:37.795174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:37.796033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 527/1037] 10.222.0.26 () {56 vars in 1105 bytes} [Thu May 5 13:35:37 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:37.803662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:37.900985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0fb13-0dab-4088-a175-1f7c1c35c218 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:37.936491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:37.937156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:37.937437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:37.937710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:37.938446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] RBAC: Adding query filter params (name=image) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:37.938751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:37.940121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e822a-b426-463e-8646-2d50146ed0ef None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:37.950578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 511/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:37.951534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.047996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647b882-889f-41d7-90ed-390117f034e2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.080071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.080733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.081015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.081535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.082548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] RBAC: Adding query filter params (type=image) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:38.082848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:38.083556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a44-c6e9-48bc-b26d-61f4938c237c None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.083840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a44-c6e9-48bc-b26d-61f4938c237c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.084112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51a44-c6e9-48bc-b26d-61f4938c237c None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.084207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:38.086065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 512/1039] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:38.090298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.090581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.090848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.094332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 528/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:38.095375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.112255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:38.113670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:38.178803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 513/1041] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:38.194488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49aefd-9688-4b8c-9d93-25e4478e685a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.204253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.233082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400996-57b6-4f87-9516-791bda81762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.233732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400996-57b6-4f87-9516-791bda81762d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.234008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400996-57b6-4f87-9516-791bda81762d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.234298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400996-57b6-4f87-9516-791bda81762d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.235081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97400996-57b6-4f87-9516-791bda81762d None admin] RBAC: Adding query filter params (interface=public, service_id=afc70e8fb2b94cfea438ae0108576ed9, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:38.235384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97400996-57b6-4f87-9516-791bda81762d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:38.236730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97400996-57b6-4f87-9516-791bda81762d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:38.241647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 529/1042] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:35:38 2022] GET /identity/v3/endpoints?service_id=afc70e8fb2b94cfea438ae0108576ed9&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:38.246959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400996-57b6-4f87-9516-791bda81762d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.301273 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2412e-0e70-4bdf-a11d-51800530d72a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.335051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.335838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.336117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.336387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.337578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:38.339025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:38.345400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 514/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:38.345544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400996-57b6-4f87-9516-791bda81762d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.346190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.377143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.377883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.378304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.379012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.380135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:38.381039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50b2f8-82cd-400f-9fb7-b5c8b110d614 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:38.388088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 530/1044] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:35:38 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:35:38.447400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fdef-3a04-4675-ad3b-6ee0205042f0 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.484461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.485158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.485441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.485714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.486504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:38.488112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88d4f-29d4-47ad-94e7-b63cd5d3ea01 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:38.610270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 515/1045] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:35:38 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:35:38.694167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcd2d-ef3b-4834-a3d6-d59ccbdcad76 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.695000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcd2d-ef3b-4834-a3d6-d59ccbdcad76 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.695000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcd2d-ef3b-4834-a3d6-d59ccbdcad76 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.696514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 531/1046] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:38.702039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.702336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.702615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.719983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:38.721161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:38.791851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 516/1047] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:38.813826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dcd2d-ef3b-4834-a3d6-d59ccbdcad76 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:38.918472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dcd2d-ef3b-4834-a3d6-d59ccbdcad76 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:38.951790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:38.952917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:38.953403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:38.953890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:38.964470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:38.972772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:38.973924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:38.974900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:38.975896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 532/1048] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:38.981675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.076875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff483b-8360-43e7-a907-e4cd7dda4ed4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.115889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.116550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.116823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.117089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.117824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:39.118174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.119527 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.132439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 517/1049] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:39.133608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.242786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65978f-0f6e-46e9-9e8d-45af6a7f36e9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.277228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.278008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.278308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.278575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.288794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.290246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:39.306863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:39.307816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:39.308787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:39.308787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:39.308787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:39.308787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:39.308787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 533/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:39.314740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.411350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eb0ca-ce98-4775-8ae1-477d7f1b8057 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.443944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.444864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.445144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.445415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.446166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:39.446472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.447834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.460418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 518/1051] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:39.465042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.568157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955237-6b35-4cb2-9f4f-340d5f32762d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.600369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.601408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.601892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.602367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.609828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.611470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:39.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:39.626601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:39.627637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 534/1052] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:39.633814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.728318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ad3ee-98c4-4875-a58e-f50607d9e1e8 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.760318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.760978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.761255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.761520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.762374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:39.762674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.764081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.785675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 519/1053] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:39.786826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:39.895374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581000f-8014-4668-9af1-c247d78e28dc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:39.927275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:39.928051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:39.928327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:39.928594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:39.938631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:39.940059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:39.957064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:39.957992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:39.965237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:39.965237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:39.965237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:39.965237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:39.965237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 535/1054] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:39.965587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:40.059068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839423-21b0-4121-814f-0c1dca4fb2e3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:40.091725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:40.092375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.092651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.098191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.098191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:40.098191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:40.098191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:40.118070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 520/1055] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:40.119301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:40.214184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612b50-9729-4f7b-83bd-a994ca373fe7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:40.245950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:40.246759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.247032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.247298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.253733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:40.255198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:40.270157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:40.271160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:40.272209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 536/1056] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:40.277095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:40.376324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376f5cd-ca57-4236-b332-54d2ba47fe52 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:40.410347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:40.410997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.411271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.411539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.412313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:40.412611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:40.414032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede352b1-b433-4738-8b3c-b9b246e63286 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:40.431762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 521/1057] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:40.434232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:40.556135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08b91-cdb8-497b-bfa8-8423928c61a0 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:40.596576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:40.597996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.598304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.598575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/7b0474cad3d2491fbf5c8020cf0d71fc` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.600841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=7140d54b537b43f588f282cd39120eb9, role_id=7b0474cad3d2491fbf5c8020cf0d71fc)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:40.602302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760020f-7612-481b-a4e7-c9c17cc2c538 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:40.695942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 537/1058] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:40 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/7140d54b537b43f588f282cd39120eb9/roles/7b0474cad3d2491fbf5c8020cf0d71fc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:40.710847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed76a4f-acab-4898-963a-2079546d7e3b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.711430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed76a4f-acab-4898-963a-2079546d7e3b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.711430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed76a4f-acab-4898-963a-2079546d7e3b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.712905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 522/1059] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:40.718747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413e4-1902-4415-868c-4b15612c2d76 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.719213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413e4-1902-4415-868c-4b15612c2d76 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.719314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413e4-1902-4415-868c-4b15612c2d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.738658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8e3413e4-1902-4415-868c-4b15612c2d76 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:40.740407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8e3413e4-1902-4415-868c-4b15612c2d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:40.816037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 538/1060] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:40.842779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed76a4f-acab-4898-963a-2079546d7e3b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:40.958516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed76a4f-acab-4898-963a-2079546d7e3b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:40.960636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23679912-383a-4d8a-af0f-95576e10e738 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.960636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23679912-383a-4d8a-af0f-95576e10e738 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.960636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23679912-383a-4d8a-af0f-95576e10e738 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.962154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 539/1061] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:40.967473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:40.967760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:40.968040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:40.985652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:40.986865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:41.008080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.009137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.009416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.009690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] PATH_INFO: `/v3/services/image` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.010923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.014539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:41.031726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:41.032944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 13:35:41.033981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:41.037017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 523/1062] 10.222.0.26 () {56 vars in 1105 bytes} [Thu May 5 13:35:40 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:41.042703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.056838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 540/1063] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:41.083148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.155991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197faff-bc7e-4a36-a50d-f90cbd9fa705 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.189625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.190311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.190590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.191403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.192146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] RBAC: Adding query filter params (name=image) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:41.192450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.193802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.193909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1201fc6-eb54-49fa-9ea1-b28bedb647d3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.199133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 524/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:41.204527 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.227115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.227885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.228167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.228434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.238370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:41.245701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:41.246750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:41.247640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 541/1065] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:41.252781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.305793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932ebb9-ab84-4d5f-82bb-b66f6b12fcd4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.339574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.340430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.340853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.341266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.342129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] RBAC: Adding query filter params (type=image) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:41.342591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.344076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.348253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39791ee0-965f-491c-bdfb-ea398dc03902 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.349242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 525/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:41.354748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.381670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.382359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.382890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.382890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.383640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:41.383944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.385314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.393095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 542/1067] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:41.399443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.453661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959818-283c-48f2-8070-44751d218b58 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.487164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.487847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.488128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.488401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.489151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.490554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.495553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3267eb-1abb-4c8c-ab87-07134af82188 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.528443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.529302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.529585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.529860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] PATH_INFO: `/v3/users/d84fc3594e02494ba04cb33fd0e8697a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.542866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=d84fc3594e02494ba04cb33fd0e8697a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.544301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.545974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 543/1068] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/users/d84fc3594e02494ba04cb33fd0e8697a => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:41.555585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.582041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 526/1069] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:35:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:35:41.661045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3a8f8-54d3-47a3-b487-332f562b5bc9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:41.702808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:41.703468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:41.703746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:41.704017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:41.773043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:41.774554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:41.870505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 544/1070] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 13:35:41.877065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:41.976896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f1d7-ce65-44a2-b491-989bd953a28b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:42.009013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:42.009860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:42.010169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:42.010446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:42.011620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:42.013045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4782b6b-7c10-45ea-9f24-90ba4605c427 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:42.020256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 527/1071] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:35:41 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:42.021434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:42.115711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89aa5-706e-43bf-a8eb-6bdca76d7bfe None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:42.148590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:42.149235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:42.149517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:42.149795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:42.150659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=1ffebef47ef34e568f9eee919f188433, user.id=d84fc3594e02494ba04cb33fd0e8697a) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:42.150971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:42.152391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24978c-2dfc-4cbd-834b-c356d4ba8db5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:42.166042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 545/1072] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:42 2022] GET /identity/v3/role_assignments?user.id=d84fc3594e02494ba04cb33fd0e8697a&scope.project.id=1ffebef47ef34e568f9eee919f188433&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:43.030398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82d0a-ab8b-496c-9cff-3e9059631cfc None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.030943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82d0a-ab8b-496c-9cff-3e9059631cfc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.030943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82d0a-ab8b-496c-9cff-3e9059631cfc None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.032535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 528/1073] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:43.038358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.038760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.038946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.055890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:43.057048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:43.125557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 546/1074] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:43.149081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a82d0a-ab8b-496c-9cff-3e9059631cfc None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.247935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a82d0a-ab8b-496c-9cff-3e9059631cfc None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:43.282439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:43.283165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.283446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.283718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.294665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:43.302790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:43.303730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 13:35:43.304623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:43.306354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 529/1075] 10.222.0.26 () {56 vars in 1120 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:43.309910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.401976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0800e7-0a84-40ed-afae-7702052407c7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:43.435510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:43.436170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.436444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.436708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.437446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:43.437742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:43.439111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:43.451993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 547/1076] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:43.453497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.551293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb798-f5a9-4cd9-bcce-2805b0343926 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:43.584571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:43.585356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.585630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.585897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.599160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:43.600644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:43.618389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:43.619662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:43.620807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:43.620807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:43.620807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:43.620807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:43.620807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 530/1077] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:35:43.627231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.728042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f8690-1877-474a-b8eb-e9937e72075e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:43.759952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:43.760608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.760893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.761161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.761881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:43.762211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:43.763562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0190c-4b38-446f-a45c-ca3dd28db7d9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:43.775873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 548/1078] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:43.781466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.852644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0e0c-df75-434e-a609-61d9ed45fa96 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.852993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0e0c-df75-434e-a609-61d9ed45fa96 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.853184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0e0c-df75-434e-a609-61d9ed45fa96 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.858079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 549/1079] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:43.860210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.860495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.860766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.877344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:43.879264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:43.885394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f2e3-1ec7-48ee-acaa-c3d9ac3de3dc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:43.919344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:43.920122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:43.920404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:43.920671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:43.928258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:43.929697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:35:43.945151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:43.946519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 13:35:43.947530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:43.948766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 550/1080] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:35:43.950290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 531/1081] 10.222.0.26 () {56 vars in 1093 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:43.951658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:43.966930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.048713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889384d3-2ba7-4e9c-8b0a-0ef100edd04e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.073201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532bcf1-aeef-4b1d-b6b3-1cc5b175c723 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.083028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.083693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.083971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.084240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.085070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:44.085398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.086844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.108539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.109371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.109491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 551/1082] 10.222.0.26 () {56 vars in 1133 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:44.109580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.109771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.115269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.181900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.183394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.217277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78419a-ce33-4688-a2bb-5862b0516fab None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.257835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.258513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.258802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.259073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.294066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 532/1083] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 13:35:44.297603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.327267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.328729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb98c9a-ab07-42a4-849b-4f7834fca2a5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.394555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365bd3-6d4c-4054-8cad-9123f764f061 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.422618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 552/1084] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 13:35:44.424026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed392-3ce6-4cba-a47a-0da4ca0afc41 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.424317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed392-3ce6-4cba-a47a-0da4ca0afc41 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.424687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed392-3ce6-4cba-a47a-0da4ca0afc41 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.426809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 553/1085] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:44.428617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.428782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed392-3ce6-4cba-a47a-0da4ca0afc41 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.429483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.429821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.430128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.440190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.442187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-7fd6e611-714d-4583-9f0d-31b63456c353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:44.462168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:44.463188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 533/1086] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.467185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.482519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:44.483692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:44.529449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed392-3ce6-4cba-a47a-0da4ca0afc41 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.545582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 534/1087] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:44.546413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.561651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.562469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.562744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.563017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.573637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.575117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:35:44.591998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:44.593060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 554/1088] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:44.598880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.653316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786070fd-d98d-4996-81bd-c1b8b0eba412 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.685361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.686035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.686324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.686597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.687315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:44.687618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.688977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.692254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caf53-6d09-4741-8b1f-54be113904fd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.700579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 535/1089] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:44.701371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.726441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.727254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.727526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.727792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.739834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:44.747515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:44.748604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:35:44.749524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 555/1090] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:44.755591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.815259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32fa8c-d33b-4296-b541-79190a284920 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.850999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.851679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.851959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.852240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.852974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:44.853283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.854725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.859703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c63c6-584e-449d-8083-2a43fd7b9879 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:44.872381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 536/1091] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:44.873583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.903093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:44.904443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:44.904443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:44.904443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:44.905540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:44.905844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:44.907238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:44.917257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 556/1092] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:44.923492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:44.982575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe4a4a-b17f-495c-88fd-f5b5d726d604 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.020425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.021221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.021500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.021769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.028452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.029879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.034284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfabd9a-3cdb-48e8-bf1f-637cbfec11c6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:35:45.043905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:45.045020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:45.046224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 537/1093] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:45.051401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:45.068618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.069745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.070040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.070329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] PATH_INFO: `/v3/users/d84fc3594e02494ba04cb33fd0e8697a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.071535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] RBAC: Authorizing `identity:get_user(user_id=d84fc3594e02494ba04cb33fd0e8697a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.072958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.074767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 557/1094] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:44 2022] GET /identity/v3/users/d84fc3594e02494ba04cb33fd0e8697a => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:45.080072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:45.147122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fdfb9-4b7b-4960-abfc-55dbf6197074 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.173932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed96b-c236-4a6c-8b23-6f26c7aa6eec None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.178248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.178897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.179175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.179470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.180253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:45.180560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.181978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.199257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 538/1095] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:45.200256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:45.206118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.207522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.207800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.208071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.209236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.210683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.212357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 558/1096] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:35:45 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:45.218150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:45.292893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02f222-dae3-4003-8414-5cc094fb9e7c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.310180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ed6a4-5b98-4cd0-a79f-56786cfbe3bc None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:45.325263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.325898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.326209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.326483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.327304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] RBAC: Adding query filter params (role.id=7b0474cad3d2491fbf5c8020cf0d71fc, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=7140d54b537b43f588f282cd39120eb9) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:45.327613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.329031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d54c7-fe04-4cd9-a3a2-5c2d549d2f82 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.335151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 539/1097] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:45 2022] GET /identity/v3/role_assignments?user.id=7140d54b537b43f588f282cd39120eb9&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=7b0474cad3d2491fbf5c8020cf0d71fc => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:35:45.343393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:45.344295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:45.344568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:45.344836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433/users/d84fc3594e02494ba04cb33fd0e8697a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:45.346923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ffebef47ef34e568f9eee919f188433, user_id=d84fc3594e02494ba04cb33fd0e8697a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:45.348941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee10df-14d7-46ff-b0f9-c3a312d72745 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:45.444099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 559/1098] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:45 2022] PUT /identity/v3/projects/1ffebef47ef34e568f9eee919f188433/users/d84fc3594e02494ba04cb33fd0e8697a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:47.682906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835cd22-d8be-4163-bcc6-789851a49aa0 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:47.683450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835cd22-d8be-4163-bcc6-789851a49aa0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:47.683450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835cd22-d8be-4163-bcc6-789851a49aa0 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:47.684808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 540/1099] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:47.689838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:47.690235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:47.690429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:47.707293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:47.708445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:47.770428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 560/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:47.792834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835cd22-d8be-4163-bcc6-789851a49aa0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:47.892948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835cd22-d8be-4163-bcc6-789851a49aa0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:47.931045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877ec3-6629-489a-a543-92641604201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:47.931822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877ec3-6629-489a-a543-92641604201a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:47.932100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877ec3-6629-489a-a543-92641604201a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:47.932368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877ec3-6629-489a-a543-92641604201a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:47.942486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86877ec3-6629-489a-a543-92641604201a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-86877ec3-6629-489a-a543-92641604201a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:35:47.950174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:35:47.951380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:35:47.952635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 541/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:35:47.957365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:48.049247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51f1a5-6e81-4061-a54d-2eab16e4254c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:48.080851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:48.082051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:48.082377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:48.082647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:48.083380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:48.083676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:48.085023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:48.092619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 561/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:48.099063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877ec3-6629-489a-a543-92641604201a None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:48.198551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877ec3-6629-489a-a543-92641604201a None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:48.236547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:48.237399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:48.238317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:48.238592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] PATH_INFO: `/v3/users/d84fc3594e02494ba04cb33fd0e8697a` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:48.239765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] RBAC: Authorizing `identity:get_user(user_id=d84fc3594e02494ba04cb33fd0e8697a)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:48.241179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:48.242827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 542/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:48 2022] GET /identity/v3/users/d84fc3594e02494ba04cb33fd0e8697a => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:48.248724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:48.342295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643830bf-d3e3-41d5-83dd-436351838e0b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:48.373672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:48.374334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:48.374617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:48.374892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:48.437403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:48.438865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:48.530677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 562/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:48.536996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:48.637035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac45b2-bbac-40ed-ad44-208140c66016 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:48.669230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:48.670085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:48.670356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:48.670617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:48.671805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:48.673207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596d78-9fb5-4ccf-910c-ec19e92c1d7b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:48.675924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 543/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:35:48 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:48.681127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:48.774308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5d1b-6c3e-4b85-81a6-c23f0d83f67d None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:48.805979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:48.806584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:48.806860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:48.807127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:48.807939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=1ffebef47ef34e568f9eee919f188433, user.id=d84fc3594e02494ba04cb33fd0e8697a) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:48.808238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:48.809628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813b807-9948-49f6-90ab-d58bc22b09ad None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:48.815323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 563/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:48 2022] GET /identity/v3/role_assignments?user.id=d84fc3594e02494ba04cb33fd0e8697a&scope.project.id=1ffebef47ef34e568f9eee919f188433&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:51.050851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7aa3b-9583-4f1d-aa90-3c7a97babd18 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:51.051385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7aa3b-9583-4f1d-aa90-3c7a97babd18 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:51.051385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7aa3b-9583-4f1d-aa90-3c7a97babd18 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:51.052729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 544/1107] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:51.057851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:51.058249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:51.058445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:51.075486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:51.076647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:51.139787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 564/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:51.164529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7aa3b-9583-4f1d-aa90-3c7a97babd18 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:51.259114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7aa3b-9583-4f1d-aa90-3c7a97babd18 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:51.290031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:51.290804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:51.291077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:51.291342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:51.292480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:51.293888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9465430-98f6-4b5c-9893-2ba7088e069e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:51.295472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 545/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:35:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:51.301077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:51.392176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433dc36-6390-4efe-82f3-f69441c417b8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:51.424103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:51.424749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:51.425072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:51.425344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:51.426062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:51.427480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc11533-56a4-4a92-adca-3a2759239123 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:51.540443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 565/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:35:51 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:35:53.801161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41349-0684-4026-9f96-c2a234079be6 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:53.801712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41349-0684-4026-9f96-c2a234079be6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:53.801712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41349-0684-4026-9f96-c2a234079be6 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:53.803086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 546/1111] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:53.808136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:53.808552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:53.808661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:53.825035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:53.826232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:53.888044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 566/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:53.911744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41349-0684-4026-9f96-c2a234079be6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:54.021447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41349-0684-4026-9f96-c2a234079be6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:54.051995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:54.052771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:54.053042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:54.053309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] PATH_INFO: `/v3/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:54.054776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] RBAC: Authorizing `identity:get_role(role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:54.056127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:54.057471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 547/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:53 2022] GET /identity/v3/roles/19dffcd65bd44f938b9378bee2156b2b => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:54.063253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:54.156830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09f79-c42a-403d-a498-970acfcd248a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:54.188307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:54.189162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:54.189437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:54.189703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] PATH_INFO: `/v3/users/109d24aba8e04cd9bb924704b7d087eb` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:54.202804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] RBAC: Authorizing `identity:get_user(user_id=109d24aba8e04cd9bb924704b7d087eb)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:54.204235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:54.205873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 567/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:54 2022] GET /identity/v3/users/109d24aba8e04cd9bb924704b7d087eb => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:54.211544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:54.321327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532f18-5e22-4784-b965-099feb86e501 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:54.353213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:54.353845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:54.354153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:54.354427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:54.417006 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:54.418472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:54.509377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 548/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:35:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:35:54.515269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:54.612223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b004-ffbc-4316-8f96-8615d1f22bfa None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:54.647421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:54.648261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:54.648541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:54.648809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:54.649965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:54.651419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b580-cd36-43d7-82c8-89050b74e156 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:54.653091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 568/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:35:54 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:54.659167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:54.751189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352c16e-743b-48f5-82d3-c7b3777e3ea9 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:54.782975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:54.783600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:54.783876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:54.784147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:54.784960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=1ffebef47ef34e568f9eee919f188433, user.id=109d24aba8e04cd9bb924704b7d087eb) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:35:54.785263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:54.786701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee28c7-bda1-4463-85c0-1a243174e89f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:54.791773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 549/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:35:54 2022] GET /identity/v3/role_assignments?user.id=109d24aba8e04cd9bb924704b7d087eb&scope.project.id=1ffebef47ef34e568f9eee919f188433&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:56.972763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2c4d-947b-4c28-abcf-b1c10b0bd2e1 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:56.973324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2c4d-947b-4c28-abcf-b1c10b0bd2e1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:56.973324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2c4d-947b-4c28-abcf-b1c10b0bd2e1 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:56.974687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 569/1118] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:35:56.979840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:56.980233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:56.980382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:56.997639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:56.998826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:57.060074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 550/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:35:57.082238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2c4d-947b-4c28-abcf-b1c10b0bd2e1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:57.177305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2c4d-947b-4c28-abcf-b1c10b0bd2e1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:57.208396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:57.209228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:57.209506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:57.209773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] PATH_INFO: `/v3/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:57.211248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] RBAC: Authorizing `identity:get_role(role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:57.212595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:57.213940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 570/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:57 2022] GET /identity/v3/roles/19dffcd65bd44f938b9378bee2156b2b => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:57.219629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:57.310268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0de866-b44d-475d-9ac2-b84dcc311e76 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:57.341472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:57.342336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:57.342615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:57.342879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] PATH_INFO: `/v3/users/109d24aba8e04cd9bb924704b7d087eb` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:57.344025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] RBAC: Authorizing `identity:get_user(user_id=109d24aba8e04cd9bb924704b7d087eb)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:57.345424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:57.347654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 551/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:35:57 2022] GET /identity/v3/users/109d24aba8e04cd9bb924704b7d087eb => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:57.353272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:57.444487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff707-dff2-4f59-8b8d-3525cf751720 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:57.476312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:57.477141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:57.477417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:57.477685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:57.478862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:57.480255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c93375-efcd-4577-869f-92f34f026992 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:57.481893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 571/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:35:57 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:35:57.487534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:35:57.578239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a58b-9d75-4263-99f0-c261bfad8044 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:35:57.609932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:35:57.610802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:57.611086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:57.611350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433/users/109d24aba8e04cd9bb924704b7d087eb/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:57.613502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=1ffebef47ef34e568f9eee919f188433, user_id=109d24aba8e04cd9bb924704b7d087eb, role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:35:57.614927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bbd79-3fba-49a9-a09d-9f187c449f6c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:35:57.688523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 552/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:35:57 2022] PUT /identity/v3/projects/1ffebef47ef34e568f9eee919f188433/users/109d24aba8e04cd9bb924704b7d087eb/roles/19dffcd65bd44f938b9378bee2156b2b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:35:59.896397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050aae-dce3-4f48-a4c0-ba31dbc6d2f5 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:59.896929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050aae-dce3-4f48-a4c0-ba31dbc6d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:59.896929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050aae-dce3-4f48-a4c0-ba31dbc6d2f5 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:59.898324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 572/1124] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:35:59.903378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:35:59.903771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:35:59.903920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:35:59.920602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:35:59.921772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:35:59.984155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 553/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:35:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:00.007556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050aae-dce3-4f48-a4c0-ba31dbc6d2f5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:00.111423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050aae-dce3-4f48-a4c0-ba31dbc6d2f5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:00.143418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:00.144258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:00.144535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:00.144802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] PATH_INFO: `/v3/roles/19dffcd65bd44f938b9378bee2156b2b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:00.146302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] RBAC: Authorizing `identity:get_role(role_id=19dffcd65bd44f938b9378bee2156b2b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:00.147695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:00.148993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 573/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:00 2022] GET /identity/v3/roles/19dffcd65bd44f938b9378bee2156b2b => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:00.154743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:00.246793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e709-dab0-4104-aca5-2dd876ed161b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:00.277742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:00.278623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:00.278904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:00.279174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] PATH_INFO: `/v3/users/109d24aba8e04cd9bb924704b7d087eb` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:00.280337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] RBAC: Authorizing `identity:get_user(user_id=109d24aba8e04cd9bb924704b7d087eb)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:00.281748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:00.283368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 554/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:00 2022] GET /identity/v3/users/109d24aba8e04cd9bb924704b7d087eb => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:00.289513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:00.391184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb4d3-511a-43c7-8f36-b5b81ef006a6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:00.423024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0792-e804-42be-b856-02b642424c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:00.423589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0792-e804-42be-b856-02b642424c83 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:00.423864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0792-e804-42be-b856-02b642424c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:00.424130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a0792-e804-42be-b856-02b642424c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:00.485613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0792-e804-42be-b856-02b642424c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:00.487101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a0792-e804-42be-b856-02b642424c83 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:00.577290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 574/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:00.583748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:00.676702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9bd3-a7f1-42da-a6d5-6524da241beb None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:00.708735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:00.709566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:00.709839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:00.710132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] PATH_INFO: `/v3/projects/1ffebef47ef34e568f9eee919f188433` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:00.711288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffebef47ef34e568f9eee919f188433)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:00.712705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bd0a1-f098-4b35-9755-f9da30809d11 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:00.714402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 555/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:00 2022] GET /identity/v3/projects/1ffebef47ef34e568f9eee919f188433 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:00.720470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0792-e804-42be-b856-02b642424c83 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:00.814583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a0792-e804-42be-b856-02b642424c83 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:00.847387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:00.848016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:00.848294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:00.848563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:00.849378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] RBAC: Adding query filter params (role.id=19dffcd65bd44f938b9378bee2156b2b, scope.project.id=1ffebef47ef34e568f9eee919f188433, user.id=109d24aba8e04cd9bb924704b7d087eb) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:00.849685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:00.851117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04990-96ed-4242-bef5-d6bc4a5205f8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:00.856695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 575/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:36:00 2022] GET /identity/v3/role_assignments?user.id=109d24aba8e04cd9bb924704b7d087eb&scope.project.id=1ffebef47ef34e568f9eee919f188433&role.id=19dffcd65bd44f938b9378bee2156b2b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:03.105119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e612a2-08ff-4969-b906-6ba2b61d74f7 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:03.105510 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e612a2-08ff-4969-b906-6ba2b61d74f7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:03.105669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e612a2-08ff-4969-b906-6ba2b61d74f7 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:03.107103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 556/1131] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:03.112047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:03.112437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:03.112611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:03.129081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:03.130258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:03.194643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 576/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:03.217680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e612a2-08ff-4969-b906-6ba2b61d74f7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:03.313568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e612a2-08ff-4969-b906-6ba2b61d74f7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:03.345567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:03.346372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:03.346650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:03.346920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:03.348069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:03.349481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35d65d-b7b4-4314-b99c-113bddb43ae3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:03.351147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 557/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:03.356796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:03.448973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358778b-b4e5-432b-9359-5653f40206d1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:03.480022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:03.480655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:03.480929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:03.481195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:03.481879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:03.483315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8b49-e93e-4054-b5c1-2f13ca57e054 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:03.552890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 577/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:36:03 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:36:05.808211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7982f-1b05-4784-9357-439f342b7da9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:05.808767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7982f-1b05-4784-9357-439f342b7da9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:05.808767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7982f-1b05-4784-9357-439f342b7da9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:05.810142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 558/1135] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:05.815355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:05.815772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:05.815912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:05.833030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:05.834232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:05.896272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 578/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:05.921067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7982f-1b05-4784-9357-439f342b7da9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:06.017630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7982f-1b05-4784-9357-439f342b7da9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:06.050166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:06.050938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:06.051218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:06.051488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:06.052656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:06.054107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111823e5-b644-4a6b-8139-cb0bc1229dc6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:06.055709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 559/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:06.061437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:06.153549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0259-1bf4-46a2-83cd-bd322efa45dc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:06.185749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:06.186431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:06.186710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:06.186981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:06.187679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:06.189092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf168c0b-197d-4c56-b7f9-cac8e5cb3637 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:06.276381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 579/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:36:06 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:36:08.528641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7dd3-b333-4d67-a529-e9d41611cbf6 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:08.529151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7dd3-b333-4d67-a529-e9d41611cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:08.529151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7dd3-b333-4d67-a529-e9d41611cbf6 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:08.530504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 560/1139] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:08.535575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:08.535982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:08.536131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:08.552906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:08.554093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:08.616494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 580/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:36:08.639687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7dd3-b333-4d67-a529-e9d41611cbf6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:08.734179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7dd3-b333-4d67-a529-e9d41611cbf6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:08.766194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:08.766953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:08.767229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:08.767496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:08.777569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:08.785590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:08.786737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:08.787763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 561/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:08.792382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:08.885747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43331d85-fad2-47d9-afec-fd101c2d9278 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:08.917666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:08.918339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:08.918615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:08.918882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:08.919615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:08.919909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:08.921265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:08.928823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 581/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:08.934638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:09.028907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086e35-ebca-47a2-adf2-eadcb199869b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:09.059835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:09.060626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:09.060903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:09.061174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] PATH_INFO: `/v3/users/573ae1656df2451aaf649fa72cfbe179` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:09.074374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] RBAC: Authorizing `identity:get_user(user_id=573ae1656df2451aaf649fa72cfbe179)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:09.075793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:09.077409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 562/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:08 2022] GET /identity/v3/users/573ae1656df2451aaf649fa72cfbe179 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:09.083518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:09.222242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd6bf-4574-4099-a8b2-40f0f039248b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:09.253340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:09.253968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:09.254274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:09.254544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:09.317016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:09.318425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:09.413447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 582/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:09.419275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:09.512868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b624f5-fadf-4d65-b0c5-e252fd45ca4b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:09.544341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:09.545176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:09.545453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:09.545720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] PATH_INFO: `/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:09.546904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f075172b0dcf4a2abbe76b62c0e0906b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:09.548311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745dc6-27a0-4a51-a014-a62784c646b3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:09.550529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 563/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:09 2022] GET /identity/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:09.556375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:09.647387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3115-734d-447e-9ba5-3fba25286887 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:09.681711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:09.682392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:09.682667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:09.682931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:09.683764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=f075172b0dcf4a2abbe76b62c0e0906b, user.id=573ae1656df2451aaf649fa72cfbe179) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:09.684065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:09.685483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400891ad-112b-4186-82ce-c8ef26d15f19 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:09.691530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 583/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:36:09 2022] GET /identity/v3/role_assignments?user.id=573ae1656df2451aaf649fa72cfbe179&scope.project.id=f075172b0dcf4a2abbe76b62c0e0906b&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:11.876840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a26aa-f568-4fc9-96f4-8c0ac559b81a None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:11.877456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a26aa-f568-4fc9-96f4-8c0ac559b81a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:11.877456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a26aa-f568-4fc9-96f4-8c0ac559b81a None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:11.878800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 564/1147] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:11.884063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:11.884424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:11.884609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:11.901128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:11.902305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:11.964352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 584/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:11.986003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a26aa-f568-4fc9-96f4-8c0ac559b81a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:12.088500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a26aa-f568-4fc9-96f4-8c0ac559b81a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:12.121216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:12.121990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:12.122298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:12.122566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:12.132735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:12.140116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:12.141219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:12.142298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 565/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:12.148207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:12.238879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adc8c-130d-468d-a58b-ef3d291a52b5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:12.271545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:12.272194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:12.272470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:12.272740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:12.273484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:12.273785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:12.275180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:12.282786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 585/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:12.288358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:12.383267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec860877-f2ca-4c8a-a8ba-c18b6b231797 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:12.414229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:12.415064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:12.415343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:12.415611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] PATH_INFO: `/v3/users/573ae1656df2451aaf649fa72cfbe179` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:12.416771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] RBAC: Authorizing `identity:get_user(user_id=573ae1656df2451aaf649fa72cfbe179)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:12.418204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:12.419791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 566/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:12 2022] GET /identity/v3/users/573ae1656df2451aaf649fa72cfbe179 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:12.425730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:12.517454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a2a2-6817-474a-939b-2b9366609c32 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:12.547671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:12.548498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:12.548770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:12.549034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] PATH_INFO: `/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:12.550813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] RBAC: Authorizing `identity:get_project(project_id=f075172b0dcf4a2abbe76b62c0e0906b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:12.552211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072c1c-672f-4169-b9c3-0530f80bc38a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:12.553829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 586/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:12 2022] GET /identity/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:12.559278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:12.653744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244369d7-52de-49eb-8ebe-b3e94df2af15 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:12.685083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4c930-af34-404e-841e-677290120a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:12.685940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c930-af34-404e-841e-677290120a80 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:12.686243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c930-af34-404e-841e-677290120a80 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:12.686512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c930-af34-404e-841e-677290120a80 None admin] PATH_INFO: `/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b/users/573ae1656df2451aaf649fa72cfbe179/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:12.688424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4c930-af34-404e-841e-677290120a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=f075172b0dcf4a2abbe76b62c0e0906b, user_id=573ae1656df2451aaf649fa72cfbe179, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:12.689828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4c930-af34-404e-841e-677290120a80 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:12.803295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 567/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:36:12 2022] PUT /identity/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b/users/573ae1656df2451aaf649fa72cfbe179/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:36:15.018607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b21e6-fa89-4e0b-ae40-bb1abe3c63d3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.019242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b21e6-fa89-4e0b-ae40-bb1abe3c63d3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.019429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b21e6-fa89-4e0b-ae40-bb1abe3c63d3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.020830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 587/1154] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:15.025912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.026336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.026492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.043338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:15.044515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:15.114312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 568/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:15.137716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b21e6-fa89-4e0b-ae40-bb1abe3c63d3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:15.233970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b21e6-fa89-4e0b-ae40-bb1abe3c63d3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:15.265550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:15.266369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.266643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.266909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.276461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:15.284398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:15.295042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:36:15.296220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 588/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:15.297194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:15.388586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764c54c-049c-463c-83d2-3fe14f607743 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:15.421509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:15.422189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.422466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.422735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.423476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:15.423781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:15.425159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:15.433025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 569/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:15.438933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:15.533074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b82f25-834e-4b47-8816-ee72cbbfe8cf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:15.564422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:15.565322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.565597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.565864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] PATH_INFO: `/v3/users/573ae1656df2451aaf649fa72cfbe179` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.567048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] RBAC: Authorizing `identity:get_user(user_id=573ae1656df2451aaf649fa72cfbe179)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:15.568460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:15.570348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 589/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:15 2022] GET /identity/v3/users/573ae1656df2451aaf649fa72cfbe179 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:15.576078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:15.669929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14fed-28d2-40b9-818d-f97ab268fcd2 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:15.702573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:15.703649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.704160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.704652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.770377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:15.771832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:15.863886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 570/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:15.869839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:15.964993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275626-9c74-437c-b0cf-844c5e872bfb None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:15.995980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:15.996819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:15.997098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:15.997372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] PATH_INFO: `/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:15.998564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] RBAC: Authorizing `identity:get_project(project_id=f075172b0dcf4a2abbe76b62c0e0906b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:15.999982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879cf0f-65e9-4f58-9b40-43bc97cd9b37 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:16.001656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 590/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:15 2022] GET /identity/v3/projects/f075172b0dcf4a2abbe76b62c0e0906b => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:16.008188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:16.104993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55546e-c9d2-4066-924e-5a75adbc4e6c None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:16.138549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:16.139127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:16.139405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:16.139676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:16.140504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=f075172b0dcf4a2abbe76b62c0e0906b, user.id=573ae1656df2451aaf649fa72cfbe179) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:16.140810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:16.142254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889fde1-ea69-4e0e-8922-e737c56cc065 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:16.147830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 571/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:36:16 2022] GET /identity/v3/role_assignments?user.id=573ae1656df2451aaf649fa72cfbe179&scope.project.id=f075172b0dcf4a2abbe76b62c0e0906b&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:18.397889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab712f0-e539-49f5-84a2-f11950222214 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:18.398437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab712f0-e539-49f5-84a2-f11950222214 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:18.398437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab712f0-e539-49f5-84a2-f11950222214 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:18.399745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 591/1162] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:18.404898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:18.405404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:18.405508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:18.421668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:18.422862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:18.484866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 572/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:18.507955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab712f0-e539-49f5-84a2-f11950222214 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:18.601394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab712f0-e539-49f5-84a2-f11950222214 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:18.632995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:18.633606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:18.633879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:18.634176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:18.696346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:18.697727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:18.788448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 592/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:18.794559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:18.886851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef9de5-a24f-4334-a537-bdb190573e7f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:18.918268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:18.919049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:18.919327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:18.919592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:18.926053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:18.927471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-b4c062c8-6b91-4bb7-8d92-e1511d2696bf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:18.941543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:18.942834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:18.943736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 573/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:36:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:18.948852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:19.051993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc3a86-6d12-456e-a79d-a96f5abd8469 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:19.083940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:19.084588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:19.084865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:19.085130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:19.085839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:19.086166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:19.087506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e955-ae8d-4459-8a3a-04f86d7fe6df None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:19.094362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 593/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu May 5 13:36:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:21.277691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22771-c98b-468d-915a-ff54ef39de0a None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:21.278259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22771-c98b-468d-915a-ff54ef39de0a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:21.278259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22771-c98b-468d-915a-ff54ef39de0a None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:21.279627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 574/1167] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:21.285163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361fcd-823e-4001-b3be-a6f87f3de372 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:21.285600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361fcd-823e-4001-b3be-a6f87f3de372 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:21.285702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361fcd-823e-4001-b3be-a6f87f3de372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:21.302470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-65361fcd-823e-4001-b3be-a6f87f3de372 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:21.303638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-65361fcd-823e-4001-b3be-a6f87f3de372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:21.366540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 594/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:21.388740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22771-c98b-468d-915a-ff54ef39de0a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:21.484764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22771-c98b-468d-915a-ff54ef39de0a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:21.515207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:21.515831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:21.516110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:21.516382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:21.517101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:21.519019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08134d95-db76-45aa-89b5-0310ea28791c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:21.608769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 575/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu May 5 13:36:21 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:36:23.833038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aeb93-1150-46a0-9f39-da05ddc00d4e None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:23.833587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aeb93-1150-46a0-9f39-da05ddc00d4e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:23.833587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aeb93-1150-46a0-9f39-da05ddc00d4e None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:23.835029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 595/1170] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:23.840104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:23.840541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:23.840669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:23.857835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:23.859042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:23.921129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 576/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:23.944125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aeb93-1150-46a0-9f39-da05ddc00d4e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:24.039057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aeb93-1150-46a0-9f39-da05ddc00d4e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:24.072012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:24.072864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:24.073143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:24.073412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] PATH_INFO: `/v3/domains/953299856c4a4ebf86c6474bdbcecb64` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:24.083519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=953299856c4a4ebf86c6474bdbcecb64)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:24.084922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37c4b6-6f41-4999-9792-251edb6a00c5 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:24.086605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 596/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu May 5 13:36:23 2022] GET /identity/v3/domains/953299856c4a4ebf86c6474bdbcecb64 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:36:24.092389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:24.192502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd3274-3f0a-4cca-be97-c67b2aa40fae None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:24.224530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:24.225175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:24.225458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:24.225734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:24.226485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:24.227946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcdd8f-1a40-4608-8ed7-2773d6f8e315 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:24.352344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 577/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:36:24 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:36:26.607199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d9b3c-722b-4581-bdea-1887c43410db None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:26.607730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d9b3c-722b-4581-bdea-1887c43410db None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:26.607730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d9b3c-722b-4581-bdea-1887c43410db None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:26.609138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 597/1174] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:26.614445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:26.614841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:26.615005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:26.631262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:26.632428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:26.696080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 578/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:26.719909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d9b3c-722b-4581-bdea-1887c43410db None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:26.818858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d9b3c-722b-4581-bdea-1887c43410db None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:26.851711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:26.852554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:26.852831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:26.853095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] PATH_INFO: `/v3/domains/953299856c4a4ebf86c6474bdbcecb64` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:26.854271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=953299856c4a4ebf86c6474bdbcecb64)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:26.855685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084afcf5-ebef-4f47-b82f-2c102b176a60 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:26.857310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 598/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu May 5 13:36:26 2022] GET /identity/v3/domains/953299856c4a4ebf86c6474bdbcecb64 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:26.862988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:26.955781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2a510-f6f2-4c0b-a7ea-c91710e50332 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:26.989470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:26.990139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:26.990420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:26.990691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:26.991391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:26.992810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7669cdb-5c74-456e-b119-99ef7fa0d06f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:27.129420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 579/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:36:26 2022] POST /identity/v3/users => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:36:29.390495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54bea-91a0-4497-9487-b65bf324daf2 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:29.391007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54bea-91a0-4497-9487-b65bf324daf2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:29.391007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54bea-91a0-4497-9487-b65bf324daf2 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:29.392323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 599/1178] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:29.398060 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:29.398441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:29.398622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:29.414788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:29.415988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:29.478798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 580/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:29.501394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a54bea-91a0-4497-9487-b65bf324daf2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:29.596700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a54bea-91a0-4497-9487-b65bf324daf2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:29.628619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:29.629392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:29.629667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:29.629932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:29.639510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:29.647007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:29.648186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:36:29.649428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 600/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:29.653792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:29.745801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454350-d4a9-41bf-9b02-496ecada7997 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:29.777930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:29.778591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:29.778868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:29.779136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:29.779873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:29.780174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:29.781520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:29.789702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 581/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:29.795070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:29.887157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876cad-a624-4ffe-8645-6cfd4a7d9dc5 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:29.918731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:29.919510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:29.919785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:29.920053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] PATH_INFO: `/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:29.932216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] RBAC: Authorizing `identity:get_user(user_id=ed81d8a89b0f4a669988b4b52adfa6c8)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:29.933631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:29.935257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 601/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:29 2022] GET /identity/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:29.941207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:30.035670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bb8d4-7c7e-4813-add2-273f6447dc62 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:30.067347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:30.067974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:30.068251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:30.068522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:30.132969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:30.134444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:30.234306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 582/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:30.241914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:30.339897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf3ce-efab-4c92-8242-b3c4ee56448c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:30.371356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:30.372197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:30.372474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:30.372749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] PATH_INFO: `/v3/projects/78e41bc723b94515b15cddd021241fe3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:30.373910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] RBAC: Authorizing `identity:get_project(project_id=78e41bc723b94515b15cddd021241fe3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:30.375490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f13119-8216-46ff-9851-ed63455032e2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:30.377734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 602/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:30 2022] GET /identity/v3/projects/78e41bc723b94515b15cddd021241fe3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:30.383854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:30.475804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3fbf-3758-4179-90ba-df3fb24ec871 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:30.509894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:30.510482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:30.510893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:30.511022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:30.511836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=78e41bc723b94515b15cddd021241fe3, user.id=ed81d8a89b0f4a669988b4b52adfa6c8) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:30.512136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:30.513716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078d9e7-8859-4d0d-99b1-df56c50fcf46 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:30.519166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 583/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:36:30 2022] GET /identity/v3/role_assignments?user.id=ed81d8a89b0f4a669988b4b52adfa6c8&scope.project.id=78e41bc723b94515b15cddd021241fe3&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:32.701797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6451-8494-426e-851a-ba4b74fb38d3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:32.702344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6451-8494-426e-851a-ba4b74fb38d3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:32.702454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6451-8494-426e-851a-ba4b74fb38d3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:32.703733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 603/1186] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:32.708847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:32.709224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:32.709390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:32.725401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:32.726593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:32.789257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 584/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:36:32.815783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6451-8494-426e-851a-ba4b74fb38d3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:32.919321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6451-8494-426e-851a-ba4b74fb38d3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:32.951148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:32.951973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:32.952200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:32.952469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:32.962617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:32.969957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:32.971105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:36:32.972183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 604/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:32.977397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:33.071319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f775e-e93f-4704-8aa4-807a3bf4eaa3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:33.103183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:33.103842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:33.104123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:33.104398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:33.105146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:33.105450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:33.106838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:33.114709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 585/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:33.120822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:33.216558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bfbd-6258-47e9-8b3e-7f6b262be410 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:33.247212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:33.248052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:33.248328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:33.248596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] PATH_INFO: `/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:33.249745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] RBAC: Authorizing `identity:get_user(user_id=ed81d8a89b0f4a669988b4b52adfa6c8)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:33.251207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:33.253344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 605/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:33 2022] GET /identity/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:33.259576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:33.353277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098272-ebfa-4a66-9fa7-fa590b8e909e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:33.385298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:33.386180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:33.386458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:33.386724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] PATH_INFO: `/v3/projects/78e41bc723b94515b15cddd021241fe3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:33.387881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] RBAC: Authorizing `identity:get_project(project_id=78e41bc723b94515b15cddd021241fe3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:33.389306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df940eb-d856-42ea-ad72-acefc7eec8bc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:33.390990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 586/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:33 2022] GET /identity/v3/projects/78e41bc723b94515b15cddd021241fe3 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:33.396801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:33.488771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72787-c198-4e2c-b591-c39e82455e4e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:33.519560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:33.520417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:33.520688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:33.520952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] PATH_INFO: `/v3/projects/78e41bc723b94515b15cddd021241fe3/users/ed81d8a89b0f4a669988b4b52adfa6c8/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:33.522888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e41bc723b94515b15cddd021241fe3, user_id=ed81d8a89b0f4a669988b4b52adfa6c8, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:33.524291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1afa5-a8cf-46b0-ba75-a1bddc4ea5a2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:33.630834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 606/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:36:33 2022] PUT /identity/v3/projects/78e41bc723b94515b15cddd021241fe3/users/ed81d8a89b0f4a669988b4b52adfa6c8/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:36:35.830489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4f60-fb5a-4bab-a757-0b52176f5905 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:35.831016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4f60-fb5a-4bab-a757-0b52176f5905 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:35.831016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4f60-fb5a-4bab-a757-0b52176f5905 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:35.832399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 587/1193] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:36:35.837456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:35.837873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:35.838006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:35.854709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:36:35.855880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:36:35.918434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 607/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 13:36:35.941387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d4f60-fb5a-4bab-a757-0b52176f5905 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.037924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d4f60-fb5a-4bab-a757-0b52176f5905 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.069246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.070296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.070575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.070844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.081405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:36:36.088778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:36:36.089930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:36:36.091131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 588/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:36:36.096537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.187986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342823fd-28f3-42c3-99cd-20f00dc07570 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.225264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.225916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.226217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.226484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.227225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:36.227525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:36.228907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:36.237192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 608/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:36.243101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.336808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d53d6-c121-4e90-b860-43444704b729 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.368114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.368952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.369224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.369490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] PATH_INFO: `/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.370642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] RBAC: Authorizing `identity:get_user(user_id=ed81d8a89b0f4a669988b4b52adfa6c8)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:36.372042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:36.373624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 589/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu May 5 13:36:36 2022] GET /identity/v3/users/ed81d8a89b0f4a669988b4b52adfa6c8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:36.379172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.471651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe3f5b-e37a-4ee2-9d77-9e8e1eb601b6 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.501777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.502422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.502699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.502966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.564785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:36.566219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:36.658499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 609/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:36:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:36:36.664124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.756823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f341-b2b0-4009-91d7-7fce0d035073 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.788472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.789307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.789588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.789867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] PATH_INFO: `/v3/projects/78e41bc723b94515b15cddd021241fe3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.791058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] RBAC: Authorizing `identity:get_project(project_id=78e41bc723b94515b15cddd021241fe3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:36.792474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b36bd-693e-499b-a8a4-ecb89326eb8f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:36.794145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 590/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu May 5 13:36:36 2022] GET /identity/v3/projects/78e41bc723b94515b15cddd021241fe3 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:36:36.799836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:36:36.892951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806de8b-fb66-41a6-800a-a48c9230f35f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:36:36.924594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:36:36.925167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:36:36.925442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:36:36.925711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:36:36.926551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=78e41bc723b94515b15cddd021241fe3, user.id=ed81d8a89b0f4a669988b4b52adfa6c8) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:36:36.926854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:36:36.928237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0532ef-8601-43db-bd1b-506a44639fff None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:36:36.933720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 610/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:36:36 2022] GET /identity/v3/role_assignments?user.id=ed81d8a89b0f4a669988b4b52adfa6c8&scope.project.id=78e41bc723b94515b15cddd021241fe3&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:01.027417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f85b-7c32-4d99-8b17-59f791cda41c None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:01.028011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f85b-7c32-4d99-8b17-59f791cda41c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:01.028011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f85b-7c32-4d99-8b17-59f791cda41c None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:01.029353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 591/1201] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:01.034456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:01.034843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:01.035021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:01.052208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:01.053378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:01.119981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 611/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:01.145041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608f85b-7c32-4d99-8b17-59f791cda41c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:01.241551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608f85b-7c32-4d99-8b17-59f791cda41c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:01.273954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:01.274747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:01.275023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:01.275289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:01.289443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:01.289443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:01.303561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:01.304723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:01.306137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:01.306137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:01.306137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:01.306137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:01.306137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 592/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:01.310820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:01.408341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f20d4-9d53-418c-b5a2-8be65228b3ab None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:01.439974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:01.440625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:01.440904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:01.441175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:01.441889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:01.442224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:01.443585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cfbb-971d-4ea3-84c7-566b20cfc0e4 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:01.454968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 612/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:01.460688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:01.554947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c2fc-d434-4ccf-a16e-e7509159e3a9 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:01.587693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:01.588402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:01.588681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:01.588956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:01.589646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:01.591125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10cb86-5824-48e6-9182-a7bad2df5dcb None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:01.692553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 593/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu May 5 13:38:01 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:38:03.953026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4973-2ad3-4c85-ba9c-90a3eb5561ee None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:03.953590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4973-2ad3-4c85-ba9c-90a3eb5561ee None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:03.953590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4973-2ad3-4c85-ba9c-90a3eb5561ee None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:03.954997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 613/1206] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:03.960231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:03.960652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:03.960753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:03.977722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:03.979489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:04.049448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 594/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:04.073183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4973-2ad3-4c85-ba9c-90a3eb5561ee None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.171506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4973-2ad3-4c85-ba9c-90a3eb5561ee None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.203768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.204490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.204776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.205086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.215578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:04.223145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:04.224313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:04.225550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 614/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:04.230470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.323991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be470e-7167-46e8-945d-8287a76bb792 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.356415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.357071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.357348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.357618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.358392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:04.358679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:04.360131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:04.367794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 595/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:04.373372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.468587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a35f7-c6ae-44ce-a974-e7f4d957c67a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.499751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.500574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.500851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.501119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.511636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:04.513109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:04.530028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:04.531115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:04.532255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:04.532255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:04.532255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:04.532255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:04.532255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 615/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:04.536914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.633571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5b8e-0b4e-4c93-8369-c5fca936fedc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.664983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.665630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.665932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.666230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.666950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:04.667418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:04.671296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:04.684596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 596/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:04.690227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.787385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06530-a495-441f-a3e2-85b13ecac67e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.819212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.820249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.820524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.820791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] PATH_INFO: `/v3/users/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.828677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:04.830160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:04.844307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:04.845486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:04.846563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 616/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:04.851276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:04.945419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24460f9c-18d2-4557-8082-6115c3b61579 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:04.977219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:04.977872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:04.978190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:04.978951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:04.980081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:04.980386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:04.981807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:04.998660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 597/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:05.004851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:05.106726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286dce-6381-4e8c-a17a-0c0999e43bcf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:05.139567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:05.140207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:05.140489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:05.140760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:05.204385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:05.205830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:05.297756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 617/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:38:05.303692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:05.404260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf02c-5fe7-4869-91bb-2c5bcd6c6871 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:05.436318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:05.437456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:05.437456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:05.437677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:05.447485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:05.448906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:05.465995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:05.467092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:05.468111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:05.468111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:05.468111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:05.468111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:05.468111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 598/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:05.472971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:05.566355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24d85-37ff-4791-9b31-c94ef767b063 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:05.598809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:05.599456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:05.599736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:05.600010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:05.600724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:05.601027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:05.602408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:05.613989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 618/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:05.619694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:05.717283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87905a-31fc-403f-8022-0331cf544ee0 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:05.749130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:05.749897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:05.750319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:05.750593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:05.756884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:05.758425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:05.772665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:05.773791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:05.774870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 599/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:05.780365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:05.875372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63e8c-5f08-4204-8c86-c4acf0b22133 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:05.907490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:05.908140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:05.908415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:05.908685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:05.909465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:05.909769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:05.911277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028be95-d4b7-411f-88e9-d7abaf29de60 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:05.922619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 619/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:05.928652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:06.023379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eea73-953a-4d42-bf11-3ad997e57ef3 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:06.054431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:06.055057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:06.055331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:06.055600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:06.056892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=f322aed419054297851d892da1249ff4) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:06.057197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:06.058627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13e5d-106d-4496-949e-89c5deff319c None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:06.063741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 600/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:38:05 2022] GET /identity/v3/role_assignments?user.id=f322aed419054297851d892da1249ff4&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:08.269143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4061-acc0-4e1a-8f42-12dd43aa7451 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.269659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4061-acc0-4e1a-8f42-12dd43aa7451 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.269773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4061-acc0-4e1a-8f42-12dd43aa7451 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.271110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 620/1220] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:08.276944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.279619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.279619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.293650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:08.294843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:08.357325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 601/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:08.379453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a4061-acc0-4e1a-8f42-12dd43aa7451 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:08.477480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a4061-acc0-4e1a-8f42-12dd43aa7451 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:08.510162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:08.510950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.511233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.511515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.521436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:08.529089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:08.530302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:08.531654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 621/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:38:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:08.536274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:08.632831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f2c3-8997-412e-9f32-b57919b332ae None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:08.666276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:08.666932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.667210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.667487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.668218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] RBAC: Adding query filter params (name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:08.668517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:08.669868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:08.677427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 602/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:38:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:08.683931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:08.779883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a3811-380f-48f2-b633-7c2314e0c16c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:08.811897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:08.815539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.815539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.815539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.823412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:08.824877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:08.840962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:08.842056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:08.843208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:08.843208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:08.843208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:08.843208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:08.843208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 622/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:08.847966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:08.943744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400d6e3-1ba8-47dc-b2a4-02c3b5cc12cc None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:08.975047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:08.975687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:08.976011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:08.976352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:08.977061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:08.977361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:08.979280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:08.990495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 603/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:08.996870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.092156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b4af-0f18-4621-94b7-44bfa267bf86 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.124985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.125776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.126083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.126355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.133657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.135154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:09.149038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:09.150701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:09.151850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 623/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:09.156764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.251997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95891e-aaae-437f-9b55-ea182fb8e967 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.284870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.285518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.285793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.286091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.286911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:09.287209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.288615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.305585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 604/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:09.311419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.406890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ac2c2-1cb0-4e9a-854d-c28787c1e280 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.438435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.439207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.439487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.439758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.450544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.451985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:09.468717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:09.471887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:09.473052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:09.473052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:09.473052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:09.473052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:09.473052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 624/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:09.475612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.568352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378b589-8307-483e-bcdc-f7bbd77c0b74 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.601076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.602940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.602940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.602940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.603247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:09.603454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.604804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.615677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 605/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:09.624821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.721908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09223d96-04c4-4034-9a23-e605518a6445 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.753962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.754763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.755038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.755307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.762308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.763799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:09.777604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:09.778702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:09.779825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 625/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:38:09.784570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:09.878904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a3a7-4cf9-4214-ad18-8b1060658238 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:09.910381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:09.911013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:09.911286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:09.911554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:09.912317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:09.912616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:09.914082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6be2eb-ed29-46e9-abcc-d1155b815128 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:09.925474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 606/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:09.932183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:10.028035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3eca-c498-482b-96c4-d08c970f95fd None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:10.059929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:10.060799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:10.061081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:10.061354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/f322aed419054297851d892da1249ff4/roles/f19c872c306547e082f5a88c0ba267e3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:10.075159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=f322aed419054297851d892da1249ff4, role_id=f19c872c306547e082f5a88c0ba267e3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:10.076587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884052-2ee4-48a1-88c9-e392b557f50e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:10.160734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 626/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:38:09 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/f322aed419054297851d892da1249ff4/roles/f19c872c306547e082f5a88c0ba267e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:38:12.371629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd155-e3ca-4a33-b205-a7bc6802aed1 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:12.372132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd155-e3ca-4a33-b205-a7bc6802aed1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:12.372372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd155-e3ca-4a33-b205-a7bc6802aed1 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:12.373554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 607/1233] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:12.378720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:12.388565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:12.388565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:12.395477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:12.396671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:12.460732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 627/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:12.483947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd155-e3ca-4a33-b205-a7bc6802aed1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:12.578952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd155-e3ca-4a33-b205-a7bc6802aed1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:12.611884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:12.612747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:12.613025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:12.613295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] PATH_INFO: `/v3/roles/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:12.623152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:12.630825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:12.631922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:12.632808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 608/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu May 5 13:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:12.638710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:12.753049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32dc5c-7661-4fa2-8dd8-0996ab099d02 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:12.786853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:12.787513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:12.787792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:12.788063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:12.788804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:12.789104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:12.790501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:12.798243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 628/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu May 5 13:38:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:12.803856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:12.902047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748b9d-0450-4522-b269-76d7ab54cede None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:12.934292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:12.935067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:12.935344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:12.935616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:12.945830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:12.947967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:12.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:12.965185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:12.966158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:12.966158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:12.966158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:12.966158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:12.966158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 609/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:12.971149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.067470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d494-0c2c-4c52-b8c5-b515e3f914b8 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:13.101532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:13.104328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:13.104328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:13.104328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:13.104328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:13.104328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:13.105326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:13.117501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 629/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:13.123467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.219917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333dd6-74e9-4caa-a018-84d64238c5bf None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:13.252092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:13.252871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:13.253149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:13.253422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:13.260633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:13.262119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:13.275849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:13.277162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:13.278414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 610/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:13.283025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.380696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85d79-cb75-4828-9765-fabf92198e90 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:13.418488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:13.419081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:13.419361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:13.419634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:13.420468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:13.420773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:13.422231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:13.439416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 630/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:13.445606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.539715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147df42c-e412-4441-a7fc-3867b3921489 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:13.572792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:13.573424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:13.573699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:13.573964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:13.636622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:13.638056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:13.735687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 611/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:38:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:38:13.741487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.835575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8e98f-50ec-45a9-848d-9169672ef0cf None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:13.868509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:13.869313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:13.869586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:13.869851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:13.879446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:13.880868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:13.897290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:13.898406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:13.899716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:13.899716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:13.899716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:13.899716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:13.899716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 631/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:13.904717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:13.997666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba2da5-a156-433c-92da-5467d70ffe10 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:14.029912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:14.030570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:14.030849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:14.031113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:14.031816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:14.032111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:14.033450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:14.044251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 612/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:14.049832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:14.144979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f613b-0f54-4818-b88d-9acaddf87d6f None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:14.177219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:14.177994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:14.178307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:14.178578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:14.184979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:14.186444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:14.200332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:14.201415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:14.202439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 632/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:14.207521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:14.302621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f38-8228-43cd-b90f-66519c7e11da None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:14.334688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:14.335323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:14.335603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:14.335874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:14.336729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:14.337028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:14.339028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe989-aaca-4e14-b3b3-86ebe063d610 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:14.351538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 613/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:14.358095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:14.455650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792acf0-a95b-4360-9149-c0905006fa60 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:14.487442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:14.488078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:14.495074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:14.495074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:14.495074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] RBAC: Adding query filter params (role.id=f19c872c306547e082f5a88c0ba267e3, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=f322aed419054297851d892da1249ff4) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:14.495074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:14.495074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be63c06-bc97-49fc-b346-907940cdb189 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:14.496709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 633/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:38:14 2022] GET /identity/v3/role_assignments?user.id=f322aed419054297851d892da1249ff4&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=f19c872c306547e082f5a88c0ba267e3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:16.757008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4021d4-c5a6-4e4a-a9de-c2c970813fe2 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:16.757534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4021d4-c5a6-4e4a-a9de-c2c970813fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:16.757534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4021d4-c5a6-4e4a-a9de-c2c970813fe2 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:16.758943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 614/1247] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:16.767117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:16.767602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:16.767715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:16.786333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:16.787610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:16.850501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 634/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:16.874118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4021d4-c5a6-4e4a-a9de-c2c970813fe2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:16.972261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4021d4-c5a6-4e4a-a9de-c2c970813fe2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.003651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.004466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.004719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.004986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.015207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:17.022559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:17.033120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:17.034226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 615/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:17.035129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.139024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b8f07-988f-4890-afeb-ff094a8213e9 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.171084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.171748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.172030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.172303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.173050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:17.173369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:17.174754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:17.183086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 635/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:17.188833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.286526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcc-2aa3-4e56-ad2f-29a7258ec062 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.319138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.320179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.320452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.320720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.330903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:17.332316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:17.349171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:17.350360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:17.355507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:17.355507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:17.355507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:17.355507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:17.355507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 616/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:17.356779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.461431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86920ee5-3bb9-48ca-935c-da0491718ee9 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.492794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.493446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.494274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.494546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.495262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:17.495562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:17.496916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:17.508073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 636/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:17.514297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.609255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c372b-0803-43ef-994f-6a39d81d416b None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.641625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.642437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.642719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.642991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.650152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:17.651580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:17.665300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:17.666965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:17.668245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 617/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:17.672838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.768464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc829503-c88f-4c0c-90cf-f8580ae69d49 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.800910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.801561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.801833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.802127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:17.803035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:17.803331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:17.804756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:17.822307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 637/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:17.827887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:17.923194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e832-37db-4235-a6c9-1c4f91066781 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:17.955327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:17.955955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:17.956240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:17.956507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.020227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.021956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.116971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 618/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:38:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:38:18.122651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:18.216319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375eb1e-7ca8-4aaf-ad4f-b06059890a50 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:18.248284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:18.249057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:18.249333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:18.249596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.259259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.261352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:18.277741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:18.278731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:18.279734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:18.279734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:18.279734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:18.279734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:18.279734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 638/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:18.284572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:18.378386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7a94c-5feb-419c-9c8a-821a6036c175 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:18.411114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:18.411760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:18.412032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:18.412299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.413005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:18.413300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.414673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.426154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 619/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:18.431884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:18.524709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd633b-91c7-47bd-8ec2-04797291734b None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:18.557969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:18.558784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:18.559067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:18.559347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.565838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.567334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:18.581264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:18.582432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:18.583588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 639/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:18.589839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:18.684527 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e468e-7f5e-4287-a6c7-988613c7af8f None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:18.716977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:18.717621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:18.717900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:18.718255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.718981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:18.725692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.725692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be62da-c1f3-4e5b-be41-ea622b426fa7 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.734224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 620/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:18.740448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:18.840219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f41d7-b60e-40d9-8740-6401ec07b92a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:18.872146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:18.872794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:18.873074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:18.873348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:18.874200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=f322aed419054297851d892da1249ff4) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:18.874508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:18.875928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf058958-4af1-415c-87c0-c0bde5238b78 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:18.881316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 640/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:38:18 2022] GET /identity/v3/role_assignments?user.id=f322aed419054297851d892da1249ff4&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:21.108311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58768c7-fe31-489d-98b6-ee7d7745be0d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.108739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58768c7-fe31-489d-98b6-ee7d7745be0d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.108739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58768c7-fe31-489d-98b6-ee7d7745be0d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.110139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 621/1261] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:21.115336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.115752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.115897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.132473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:21.133628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:21.197091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 641/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:21.220378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58768c7-fe31-489d-98b6-ee7d7745be0d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:21.317229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58768c7-fe31-489d-98b6-ee7d7745be0d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:21.350681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:21.351384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.351664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.351936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.362306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:21.369756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:21.370978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:21.372049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 622/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:21.377507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:21.470339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638282-8d16-407f-9a8d-d61bd4d1253b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:21.501315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:21.501955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.502257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.502523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.503252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:21.503546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:21.504891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:21.512972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 642/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:21.518899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:21.612785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad329-7ba7-447d-8c4c-295cc426aa82 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:21.643819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:21.644588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.644866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.645133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.655539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:21.656948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:21.673768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:21.674913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:21.684259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:21.684259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:21.684259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:21.684259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:21.684259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 623/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:38:21.684641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:21.777624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e17f-af74-4252-865c-060cddb1a228 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:21.809356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:21.810001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.810309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.810582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.811291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:21.811592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:21.812979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:21.825039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 643/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:21.830897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:21.927830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7827b8f-06a8-49eb-8625-75d56504a87d None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:21.959310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:21.960101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:21.960378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:21.960647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:21.968394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:21.969821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:21.984142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:21.985331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:21.986646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 624/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:21.991135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.084752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a6f9-bbf3-4c98-beeb-703b1354ca21 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.118182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.118959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.119229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.119500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.120333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:22.120633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.122069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.139014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 644/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:22.144624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.240455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53b7ef-0cd5-4108-b907-c3d3c36d32e4 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.272617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.273371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.273645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.273914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.284717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.286165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:22.303142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:22.304271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:22.305610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:22.305610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:22.305610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:22.305610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:22.305610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 625/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:22.310082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.412429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc0d9c-0312-4048-9902-30e72f7024ca None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.444063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.444986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.445263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.445533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.446271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:22.446570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.448422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.459104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 645/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:22.465501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.559607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca01f-4bf4-40af-945c-36b6082ab42e None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.591745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.592516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.592791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.593055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.599568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.600990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:22.614778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:22.615845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:22.617199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 626/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:22.622533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.721792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25522b-22e3-474e-b066-938ff6d9c016 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.753387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.754065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.754350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.754629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.755415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:22.755720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.757144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab10e70-7809-42e9-8882-c1fde924f37c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.769830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 646/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:22.776591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:22.875980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c99cde-1201-4cc6-85c8-e6381a927405 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:22.908655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:22.909520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:22.909855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:22.910166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] PATH_INFO: `/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/f322aed419054297851d892da1249ff4/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:22.912127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e5a3bf3e545529ab911da547b4211, user_id=f322aed419054297851d892da1249ff4, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:22.913558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ff708-1759-4d8b-ad6d-3c8956949eb6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:22.988421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 627/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu May 5 13:38:22 2022] PUT /identity/v3/projects/ac9e5a3bf3e545529ab911da547b4211/users/f322aed419054297851d892da1249ff4/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:38:25.207728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb727-a4f3-4eba-8fe7-f429cee37701 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.208303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb727-a4f3-4eba-8fe7-f429cee37701 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.208303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb727-a4f3-4eba-8fe7-f429cee37701 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.209625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 647/1274] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:25.214999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.219227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.219227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.232257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:25.233448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:25.297547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 628/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:25.321471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cb727-a4f3-4eba-8fe7-f429cee37701 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:25.417796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cb727-a4f3-4eba-8fe7-f429cee37701 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:25.450467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:25.451241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.451519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.451786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.461404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 13:38:25.468838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:25.473717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:25.474934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 648/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu May 5 13:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:25.476252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:25.570577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e101-34c1-4195-84df-faaff7780fb0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:25.602286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:25.603523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.603805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.604070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.604807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] RBAC: Adding query filter params (name=admin) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:25.605104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:25.606478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:25.614144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 629/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu May 5 13:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:25.619720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:25.714352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e93a-4ff9-467d-bba5-9b98eaae867c None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:25.746615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:25.747398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.747735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.748007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.757995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:25.759471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:25.776305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:25.777408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:25.778567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:25.778567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:25.778567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:25.778567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:25.778567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 649/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 13:38:25.783221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:25.880163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaa0eb-59cb-4421-a8e3-40a38d009ade None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:25.912733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:25.913378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:25.913657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:25.913926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:25.914666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:25.914964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:25.917617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:25.930348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 630/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:38:25.936225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.036782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1245f-d7ea-4b26-9882-f6c1feef14e2 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.069294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.070373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.070649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.070915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:26.078602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:26.080040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 13:38:26.094707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:26.095717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:26.100278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 650/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:26.102175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.195185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270809-ba8a-4cb3-ba32-3d2fdc156b33 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.228032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.228682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.228962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.229234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:26.230088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:26.230428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:26.231894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:26.248279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 631/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu May 5 13:38:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:26.253959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.349713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66bf71-7649-4993-bd32-5c7073c4989a None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.381546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.382206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.382478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.382745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:26.446099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:26.448136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:26.538299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 651/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu May 5 13:38:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 13:38:26.544165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.636925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664249df-328d-4eff-86bc-7bc958081eb6 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.668456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.669226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.669500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.669763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:26.684827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:26.687241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 13:38:26.704479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:26.705568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:26.706572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 13:38:26.706572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 13:38:26.706572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 13:38:26.706572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:26.706572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 632/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:26.711439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.804519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f93-d78a-4d6b-912c-6e6859401884 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.837769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.838487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.838803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.839073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:26.839778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:26.840074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:26.841456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:26.852210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 652/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu May 5 13:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:26.858467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:26.960448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c114-a1ae-4dc9-a50a-968009d75821 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:26.992563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:26.993345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:26.994172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:26.994458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:27.000870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:27.002328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 13:38:27.015581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application with Lock( May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:27.020004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: ERROR keystone.server.flask.application May 05 13:38:27.021158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 633/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu May 5 13:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:27.022624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:27.120849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c810-fc4d-4ff6-a902-94c38715e8e7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:27.152021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:27.152660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:27.152938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:27.153202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:27.153971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:27.154303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:27.155709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d5514-872c-44b8-8d79-ca06fef8dd97 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:27.167440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 653/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu May 5 13:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:38:27.173424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:27.267383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30611ac2-f993-44fc-b6e8-aa3258f300ed None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:27.300185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:27.300879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:27.301157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:27.301428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:27.302290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] RBAC: Adding query filter params (role.id=3181dfff2bfd45d7a93875a9f86af19f, scope.project.id=ac9e5a3bf3e545529ab911da547b4211, user.id=f322aed419054297851d892da1249ff4) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:27.302598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:27.304020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446c1f3-19f8-4d8f-b408-92f14940a33a None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:27.309667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 634/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu May 5 13:38:27 2022] GET /identity/v3/role_assignments?user.id=f322aed419054297851d892da1249ff4&scope.project.id=ac9e5a3bf3e545529ab911da547b4211&role.id=3181dfff2bfd45d7a93875a9f86af19f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:29.597412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce189-1cbd-42bb-a7e4-fe8f3b9c9194 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:29.597943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce189-1cbd-42bb-a7e4-fe8f3b9c9194 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:29.597943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce189-1cbd-42bb-a7e4-fe8f3b9c9194 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:29.599367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 654/1288] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:29.604347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:29.604764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:29.608389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:29.621561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:29.622744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:29.685112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 635/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:29.707262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce189-1cbd-42bb-a7e4-fe8f3b9c9194 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:29.803363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce189-1cbd-42bb-a7e4-fe8f3b9c9194 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:29.835516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:29.836291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:29.836612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:29.836882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:29.837550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:29.838926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:29.850253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:29.851317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:29.852506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 655/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:38:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:29.857867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:29.950193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d4aac-1499-4947-915d-4cbe21aaea21 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:29.982372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:29.983026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:29.983304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:29.983575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:29.984279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:29.984579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:29.985937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab902c6-7128-4c0a-b389-378017a891ac None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:29.990861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 636/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu May 5 13:38:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:29.997227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:30.091203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152bfbd-5551-4915-8522-301f9b362116 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:30.124650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:30.125245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:30.125523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:30.125790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] PATH_INFO: `/v3/services` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:30.126519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:30.126820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:30.128184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5247a5f-6cb8-4b27-ac2f-5241f183c823 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:30.132419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 656/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu May 5 13:38:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:32.350383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d915-3903-4e09-8871-3724c926eca2 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:32.350920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d915-3903-4e09-8871-3724c926eca2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:32.351010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d915-3903-4e09-8871-3724c926eca2 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:32.352326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 637/1293] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:32.358328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068cfb-67a5-4db0-b8c4-e72d56826f6d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:32.358835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068cfb-67a5-4db0-b8c4-e72d56826f6d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:32.358835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068cfb-67a5-4db0-b8c4-e72d56826f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:32.376500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2e068cfb-67a5-4db0-b8c4-e72d56826f6d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:32.377706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2e068cfb-67a5-4db0-b8c4-e72d56826f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:32.454121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 657/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:32.477573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d915-3903-4e09-8871-3724c926eca2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:32.579656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d915-3903-4e09-8871-3724c926eca2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:32.611513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:32.612107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:32.612388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:32.612663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:32.613386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:32.614821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614526d-0d2a-46e5-bae2-1867d0d1a0b9 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:32.679681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 638/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu May 5 13:38:32 2022] POST /identity/v3/services => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:38:34.928975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa69-8b34-4b15-ace9-b5f648b1625d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:34.929535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa69-8b34-4b15-ace9-b5f648b1625d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:34.929877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa69-8b34-4b15-ace9-b5f648b1625d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:34.931929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 658/1296] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:34.937122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:34.937555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:34.937671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:34.954120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:34.955281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:35.022914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 639/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:35.045911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471aa69-8b34-4b15-ace9-b5f648b1625d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:35.143429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471aa69-8b34-4b15-ace9-b5f648b1625d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:35.175081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:35.175930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:35.176210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:35.176482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:35.177133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:35.178532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:35.190722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:35.191731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:35.192769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 659/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:38:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:35.198138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:35.289867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862dba-7797-4634-a28f-3b91853714c2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:35.322166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:35.322808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:35.323081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:35.323346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:35.324034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:35.324332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:35.325677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:35.330562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 640/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu May 5 13:38:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:35.336504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:35.432369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997e3b-9ab5-4935-afd7-d3ba7864ed0e None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:35.464800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:35.465420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:35.465699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:35.465971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:35.466787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] RBAC: Adding query filter params (interface=public, service_id=6fb3708445d9465cad21f243e872dba4, region_id=RegionOne) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:35.467096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:35.468452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be256b-83aa-4fe7-9102-159e5a91e05c None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:35.473325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 660/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu May 5 13:38:35 2022] GET /identity/v3/endpoints?service_id=6fb3708445d9465cad21f243e872dba4&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:38:35.479600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:35.577569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1cc1-b5bc-4793-b47c-01ad973e7a99 None admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:35.609875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:35.610545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:35.610826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:35.611095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:35.611763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:35.613113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679365e-8e60-43e5-9354-99fa5f9eb200 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:35.619717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 641/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu May 5 13:38:35 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:38:37.825829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f9ce-7b60-45ef-a01f-ea69debd9820 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:37.826438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f9ce-7b60-45ef-a01f-ea69debd9820 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:37.826438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f9ce-7b60-45ef-a01f-ea69debd9820 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:37.827877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 661/1302] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:38:37.832864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:37.833283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:37.833397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:37.849674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:38:37.850869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:38:37.914464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 642/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:38:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 13:38:37.938134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f9ce-7b60-45ef-a01f-ea69debd9820 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:38.039394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f9ce-7b60-45ef-a01f-ea69debd9820 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:38.073436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:38.074246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:38.074529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:38.074798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:38.079594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:38.079594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 13:38:38.088373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 13:38:38.089623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 13:38:38.090760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 662/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu May 5 13:38:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 13:38:38.095846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:38.191863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeabd7-0b35-4619-bec1-5aa07773574a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:38.224709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:38.225358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:38.225635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:38.225905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] PATH_INFO: `/v3/services` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:38.226639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:38:38.226998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:38.228906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c979-c926-42f0-bb4e-017b5346e841 None admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:38.233859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 643/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu May 5 13:38:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:38:38.239788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:38:38.334342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315412cc-8e8a-456e-9676-a8c45aad73b7 None admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:38:38.366417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:38:38.367049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:38:38.367326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:38:38.367647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:38:38.368397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:38:38.369750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c109-60a7-4be6-bccc-eec8d06b5098 None admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:38:38.523048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 663/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu May 5 13:38:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:45:38.334004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb83b-90a5-4746-b8be-91a440d99d6d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:38.334908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb83b-90a5-4746-b8be-91a440d99d6d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:38.335328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb83b-90a5-4746-b8be-91a440d99d6d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:38.342474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8740-5e76-4e27-abdf-c9abc833221d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:38.343280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8740-5e76-4e27-abdf-c9abc833221d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:38.343705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8740-5e76-4e27-abdf-c9abc833221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:38.346656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 644/1307] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:38.416781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-df6b8740-5e76-4e27-abdf-c9abc833221d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:38.418867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-df6b8740-5e76-4e27-abdf-c9abc833221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:38.618863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 664/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:45:38.657501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:38.657791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:38.658096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:38.659752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 645/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu May 5 13:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:38.665577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699a63-0a4a-4409-ade5-abfab57f4d0c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:38.665912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699a63-0a4a-4409-ade5-abfab57f4d0c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:38.666194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699a63-0a4a-4409-ade5-abfab57f4d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:38.769046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-41699a63-0a4a-4409-ade5-abfab57f4d0c None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:38.770348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-41699a63-0a4a-4409-ade5-abfab57f4d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:38.860969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 665/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu May 5 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:38.870858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:38.873225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:38.990346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efa688-3c6c-42db-a9c0-4266a0561b14 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:39.065436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:39.066109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:39.066386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:39.066653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:39.068247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:39.177889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:39.179377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c85bb-2012-4f4d-aadf-c10677b91694 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:39.198277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 646/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:41.749236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:41.749763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:41.749763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:41.751181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 666/1312] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:45:41.756384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8545-d4f6-4314-a771-120800da1abf None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:41.756806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8545-d4f6-4314-a771-120800da1abf None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:41.756975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8545-d4f6-4314-a771-120800da1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:41.844252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-69cc8545-d4f6-4314-a771-120800da1abf None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:41.845453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-69cc8545-d4f6-4314-a771-120800da1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:41.938996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 647/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:41.976035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:41.977537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:42.085418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd2659-dd8b-47bd-bcc2-706bdddb79e8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:42.166539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:42.167192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:42.167471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:42.168239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:42.169860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:42.275712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:42.277146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9eea6-52f1-4625-a689-b539454036aa service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:42.295462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 667/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:45.173662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:45.174275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:45.174275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:45.175693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 648/1315] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:45.181698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690d09-5791-45ce-9d3a-af1271173042 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:45.182310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690d09-5791-45ce-9d3a-af1271173042 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:45.182404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690d09-5791-45ce-9d3a-af1271173042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:45.246108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d8690d09-5791-45ce-9d3a-af1271173042 None None] MFA Rules not processed for user `5bef4ce41a6a4937a143e45b440eaa6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:45.247301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d8690d09-5791-45ce-9d3a-af1271173042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:45.340553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 668/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:45.379789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:45.381302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:45.488620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c9748-0e18-474d-9e18-8413806e98c3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:45.559298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:45.559947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:45.560216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:45.560486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:45.562150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:45.670224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:45.671669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1ae3-44d2-41dd-a7ae-e4a8b79ab714 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:45.689065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 649/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:48.616207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:48.616742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:48.616742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:48.618157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 669/1318] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:48.623820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ae90-0a9e-42f4-b0ef-51fb29608512 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:48.624221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ae90-0a9e-42f4-b0ef-51fb29608512 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:48.624375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ae90-0a9e-42f4-b0ef-51fb29608512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:48.686822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7787ae90-0a9e-42f4-b0ef-51fb29608512 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:48.688004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7787ae90-0a9e-42f4-b0ef-51fb29608512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:48.779468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 650/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:48.817954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:48.819486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:48.920202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577e2d-b849-499d-abcf-8ce9197d7e4f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:48.988994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:48.989630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:48.989909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:48.990208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:48.991811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:49.095681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:49.097158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488186-9082-4de3-90cf-b25d97f6b558 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:49.115195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 670/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:52.422352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:52.422933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:52.422933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:52.424261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 651/1321] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:52.429296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1111-8636-4346-a81c-2c25ecab100d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:52.429720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1111-8636-4346-a81c-2c25ecab100d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:52.430004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1111-8636-4346-a81c-2c25ecab100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:52.492928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a17a1111-8636-4346-a81c-2c25ecab100d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:52.494155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a17a1111-8636-4346-a81c-2c25ecab100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:52.590716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 671/1322] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:52.626422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:52.628014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:52.727887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8f1d-a15d-43fa-a44a-61f127c6c694 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:52.798031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:52.798690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:52.798969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:52.799238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:52.800864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:52.906936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:52.908377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a2513-2760-45cd-b287-9427aec48023 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:52.927150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 652/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:55.263714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:55.264240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:55.264240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:55.265649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 672/1324] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:55.270802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866e3a-46a8-49b6-b05e-49ca1cef9c82 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:55.271198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866e3a-46a8-49b6-b05e-49ca1cef9c82 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:55.271345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866e3a-46a8-49b6-b05e-49ca1cef9c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:55.333650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ba866e3a-46a8-49b6-b05e-49ca1cef9c82 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:55.334863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ba866e3a-46a8-49b6-b05e-49ca1cef9c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:55.428373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 653/1325] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:55.463994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:55.466386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:55.571844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc087d-341c-4c57-899f-f37f630437dd None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:55.644195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:55.644841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:55.645122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:55.645395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:55.647135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:55.753754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:55.755167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d82-8a0e-4ced-930d-223ea67721df service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:55.773840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 673/1326] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:45:58.098911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:58.099406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:58.099865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:58.102634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 654/1327] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:45:58.108513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6bc7-d5fd-4a08-a60e-514e725adca0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:58.108940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6bc7-d5fd-4a08-a60e-514e725adca0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:58.109186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6bc7-d5fd-4a08-a60e-514e725adca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:58.171530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-dffd6bc7-d5fd-4a08-a60e-514e725adca0 None None] MFA Rules not processed for user `5bef4ce41a6a4937a143e45b440eaa6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:45:58.172726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dffd6bc7-d5fd-4a08-a60e-514e725adca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:58.265520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 674/1328] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:45:58.475825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:45:58.475825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:58.475825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b1a7e-515e-43c8-b36d-d46c6af493f4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:45:58.484205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:45:58.484875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:45:58.485160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:45:58.485435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:45:58.487570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:45:58.600642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:45:58.602118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20377827-d6c0-4981-bcab-653dc2e6275e service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:45:58.619998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 655/1329] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:45:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:01.310641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:01.311152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:01.311152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:01.312490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 675/1330] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:01.317685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691103f-cd40-44e5-b26a-b9bd8db76a2b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:01.318157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691103f-cd40-44e5-b26a-b9bd8db76a2b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:01.318256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691103f-cd40-44e5-b26a-b9bd8db76a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:01.382160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2691103f-cd40-44e5-b26a-b9bd8db76a2b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:01.383359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2691103f-cd40-44e5-b26a-b9bd8db76a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:01.477737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 656/1331] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:01.516465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:01.517984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:01.621423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0f87-31c4-47de-9d80-fac31b882dd7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:01.694914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:01.695560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:01.695836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:01.696107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:01.697725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:01.811051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:01.812507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330245e-1067-4097-b9a9-918986317632 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:01.831084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 676/1332] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:04.169849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:04.170380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:04.170501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:04.171812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 657/1333] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:04.177455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3cdf-96d2-452b-b937-4b2dc7fb23aa None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:04.177864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3cdf-96d2-452b-b937-4b2dc7fb23aa None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:04.178029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3cdf-96d2-452b-b937-4b2dc7fb23aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:04.241295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-db3f3cdf-96d2-452b-b937-4b2dc7fb23aa None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:04.242534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-db3f3cdf-96d2-452b-b937-4b2dc7fb23aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:04.333669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 677/1334] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:04.374272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:04.375777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:04.485969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52718fd6-2616-40b8-b984-2796ff27711d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:04.557420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:04.558087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:04.558371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:04.558642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:04.560263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:04.665083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:04.666487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88440937-a681-47b9-b4dd-eee89600dc1d service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:04.683904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 658/1335] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:07.483747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:07.484265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:07.484265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:07.485619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 678/1336] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:07.490908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f8ed-82a9-49a4-9afe-471cfed0cadd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:07.491315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f8ed-82a9-49a4-9afe-471cfed0cadd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:07.491467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f8ed-82a9-49a4-9afe-471cfed0cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:07.558993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4a12f8ed-82a9-49a4-9afe-471cfed0cadd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:07.560239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4a12f8ed-82a9-49a4-9afe-471cfed0cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:07.657366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 659/1337] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:07.691854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:07.693352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:07.793777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e77b0-bf2b-4b6f-ab16-4c31330215a3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:07.862966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:07.863612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:07.863895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:07.864165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:07.865769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:07.970153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:07.971583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc8bd4-d5c6-4646-8ed6-14cba35b41f2 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:07.989180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 679/1338] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:12.383033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b07f2-dadb-413e-873d-e6f63ba8e384 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:12.383595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b07f2-dadb-413e-873d-e6f63ba8e384 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:12.383595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b07f2-dadb-413e-873d-e6f63ba8e384 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:12.384980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 660/1339] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:12.390369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f6c9-80a0-4831-aba3-ea85b9f9eb12 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:12.390788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f6c9-80a0-4831-aba3-ea85b9f9eb12 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:12.390932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f6c9-80a0-4831-aba3-ea85b9f9eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:12.463784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-09e0f6c9-80a0-4831-aba3-ea85b9f9eb12 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:12.465400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-09e0f6c9-80a0-4831-aba3-ea85b9f9eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:12.565860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 680/1340] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:12.620992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc067-e7e4-47de-b9ba-70017efcbce3 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:12.621276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc067-e7e4-47de-b9ba-70017efcbce3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:12.621606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc067-e7e4-47de-b9ba-70017efcbce3 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:12.623101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 661/1341] 10.222.0.26 () {54 vars in 964 bytes} [Thu May 5 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:12.633660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874d42-441e-472e-a3bd-ca6582c25f96 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:12.633945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874d42-441e-472e-a3bd-ca6582c25f96 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:12.634249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874d42-441e-472e-a3bd-ca6582c25f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:12.719479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c4874d42-441e-472e-a3bd-ca6582c25f96 None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:12.720593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c4874d42-441e-472e-a3bd-ca6582c25f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:12.793353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 681/1342] 10.222.0.26 () {58 vars in 1061 bytes} [Thu May 5 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:12.802220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babc067-e7e4-47de-b9ba-70017efcbce3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:12.813666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babc067-e7e4-47de-b9ba-70017efcbce3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:12.817096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:12.817728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:12.818001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:12.818298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:12.827986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:12.829797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f422f8-24a5-48e6-ae18-da8aa95757c5 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:12.840067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 662/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:16.707711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5fc-7b7d-445b-a132-106e5fffbf69 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:16.708278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5fc-7b7d-445b-a132-106e5fffbf69 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:16.708278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5fc-7b7d-445b-a132-106e5fffbf69 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:16.709628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 682/1344] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:16.714760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbaca2-414d-41e1-89de-c80753856120 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:16.715199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbaca2-414d-41e1-89de-c80753856120 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:16.715297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbaca2-414d-41e1-89de-c80753856120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:16.741869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-92dbaca2-414d-41e1-89de-c80753856120 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:16.743068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-92dbaca2-414d-41e1-89de-c80753856120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:16.816488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 663/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:16.853689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe5fc-7b7d-445b-a132-106e5fffbf69 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:16.864845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe5fc-7b7d-445b-a132-106e5fffbf69 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:16.868334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:16.868963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:16.869239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:16.869507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:16.878723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:16.880145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedf07f-044f-4886-899e-99e8bc33c960 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:16.889460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 683/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:21.682126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765449f-a19a-4a80-8c26-286765023858 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:21.682710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765449f-a19a-4a80-8c26-286765023858 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:21.682710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765449f-a19a-4a80-8c26-286765023858 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:21.684101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 664/1347] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:46:21.689796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9b78-7643-4dbc-8ea1-a4fe54d327b9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:21.690351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9b78-7643-4dbc-8ea1-a4fe54d327b9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:21.690464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9b78-7643-4dbc-8ea1-a4fe54d327b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:21.709245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6f2f9b78-7643-4dbc-8ea1-a4fe54d327b9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:21.710486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6f2f9b78-7643-4dbc-8ea1-a4fe54d327b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:21.718924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 684/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:21.755944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765449f-a19a-4a80-8c26-286765023858 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:21.767256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765449f-a19a-4a80-8c26-286765023858 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:21.770830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:21.771532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:21.771891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:21.772255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:21.781928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:21.783390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecb2d-ae5c-482e-b5a8-2e693e50a7fa service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:21.792914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 665/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:27.044699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2d33-1290-47c4-bde7-96150401637b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:27.045637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2d33-1290-47c4-bde7-96150401637b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:27.046085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2d33-1290-47c4-bde7-96150401637b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:27.047924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 685/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:46:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:46:27.052893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff31e-ad6e-43e8-bfe4-8c6bf765580a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:27.053639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff31e-ad6e-43e8-bfe4-8c6bf765580a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:27.054091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff31e-ad6e-43e8-bfe4-8c6bf765580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:27.113688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b0bff31e-ad6e-43e8-bfe4-8c6bf765580a None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:27.115241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b0bff31e-ad6e-43e8-bfe4-8c6bf765580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:27.197018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 666/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:31.452737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6573-0573-4eaf-bc06-b6f34c5eab91 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:31.454118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6573-0573-4eaf-bc06-b6f34c5eab91 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:31.454622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6573-0573-4eaf-bc06-b6f34c5eab91 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:31.456015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 686/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:31.461577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59a9f2-fa43-4acd-9294-9f494784070e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:31.462061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59a9f2-fa43-4acd-9294-9f494784070e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:31.462162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59a9f2-fa43-4acd-9294-9f494784070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:31.480873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-bc59a9f2-fa43-4acd-9294-9f494784070e None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:31.482212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bc59a9f2-fa43-4acd-9294-9f494784070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:31.491356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 667/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:46:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:33.133502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c78a1-c383-4929-b158-41b6048868aa None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:33.134004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c78a1-c383-4929-b158-41b6048868aa None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:33.134169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c78a1-c383-4929-b158-41b6048868aa None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:33.135771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 687/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:33.141020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb5c7-d562-4468-bc2d-30af786e9296 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:33.141465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb5c7-d562-4468-bc2d-30af786e9296 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:33.141561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb5c7-d562-4468-bc2d-30af786e9296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:33.159326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2afdb5c7-d562-4468-bc2d-30af786e9296 None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:33.160488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2afdb5c7-d562-4468-bc2d-30af786e9296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:33.169446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 668/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:36.976848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5419bc3-e21c-4bc7-a66c-bef7da5e62ae None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:36.977346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5419bc3-e21c-4bc7-a66c-bef7da5e62ae None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:36.977442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5419bc3-e21c-4bc7-a66c-bef7da5e62ae None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:36.978940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 688/1356] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:36.984314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8ec8-58aa-4bde-9cad-4d99a903ba1e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:36.984729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8ec8-58aa-4bde-9cad-4d99a903ba1e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:36.984870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8ec8-58aa-4bde-9cad-4d99a903ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:37.002822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3ade8ec8-58aa-4bde-9cad-4d99a903ba1e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:37.004177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3ade8ec8-58aa-4bde-9cad-4d99a903ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:37.016295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 669/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:37.061590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc85d-4205-4c6d-963d-4c0c51e5afc3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:37.061986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc85d-4205-4c6d-963d-4c0c51e5afc3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:37.062375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc85d-4205-4c6d-963d-4c0c51e5afc3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:37.064253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 689/1358] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:37.068959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0db-3c48-4878-ac9a-1f351956bb0f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:37.069251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0db-3c48-4878-ac9a-1f351956bb0f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:37.069529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0db-3c48-4878-ac9a-1f351956bb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:37.123345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e508b0db-3c48-4878-ac9a-1f351956bb0f None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:37.124525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e508b0db-3c48-4878-ac9a-1f351956bb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:37.212714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 670/1359] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:37.222271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc85d-4205-4c6d-963d-4c0c51e5afc3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:37.240019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc85d-4205-4c6d-963d-4c0c51e5afc3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:37.246582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:37.247520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:37.248014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:37.248526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:37.258646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:37.260665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf047c5e-6ef3-4c8d-bf20-1b4da2921d09 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:37.270802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 690/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:39.723445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba43-0893-4c1c-9a43-20e658879186 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:39.723958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba43-0893-4c1c-9a43-20e658879186 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:39.723958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba43-0893-4c1c-9a43-20e658879186 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:39.725255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 671/1361] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:39.730644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744942-cf4a-4d78-9727-e4d0bda7b95c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:39.731085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744942-cf4a-4d78-9727-e4d0bda7b95c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:39.731181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744942-cf4a-4d78-9727-e4d0bda7b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:39.749478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f5744942-cf4a-4d78-9727-e4d0bda7b95c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:39.750712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f5744942-cf4a-4d78-9727-e4d0bda7b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:39.758559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 691/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:39.801950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ba43-0893-4c1c-9a43-20e658879186 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:39.816678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ba43-0893-4c1c-9a43-20e658879186 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:39.823208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:39.824094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:39.824616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:39.825111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:39.834304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:39.836143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5207e5-61ad-4416-855e-69af051f51ea service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:39.846978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 672/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:42.540347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43263c-bfd3-409a-8c34-9d8a2a5cc9d3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:42.540868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43263c-bfd3-409a-8c34-9d8a2a5cc9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:42.540868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43263c-bfd3-409a-8c34-9d8a2a5cc9d3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:42.542783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 692/1364] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:42.547956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303078-6ff9-4dae-8639-07d1e2903ef2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:42.548348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303078-6ff9-4dae-8639-07d1e2903ef2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:42.548502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303078-6ff9-4dae-8639-07d1e2903ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:42.565904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-79303078-6ff9-4dae-8639-07d1e2903ef2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:42.567223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-79303078-6ff9-4dae-8639-07d1e2903ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:42.575393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 673/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:42.621964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d419-ed53-471a-9347-d62417fbbe6a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:42.622379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d419-ed53-471a-9347-d62417fbbe6a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:42.622722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d419-ed53-471a-9347-d62417fbbe6a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:42.624161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 693/1366] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:42.629263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac9d9-b97f-434c-a2d2-5079d0b8fc2e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:42.629550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac9d9-b97f-434c-a2d2-5079d0b8fc2e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:42.629825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac9d9-b97f-434c-a2d2-5079d0b8fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:42.647551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-faaac9d9-b97f-434c-a2d2-5079d0b8fc2e None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:42.648780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-faaac9d9-b97f-434c-a2d2-5079d0b8fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:42.658836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 674/1367] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:42.667087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327d419-ed53-471a-9347-d62417fbbe6a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:42.688920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327d419-ed53-471a-9347-d62417fbbe6a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:42.695192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:42.695916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:42.696253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:42.696625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:42.706285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:42.707895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec235b0-c95c-443a-894e-623f29220a19 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:42.717297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 694/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:45.141624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463401-acc8-423f-9d92-d621998cb69b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.142171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463401-acc8-423f-9d92-d621998cb69b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.142255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463401-acc8-423f-9d92-d621998cb69b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.143863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 675/1369] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:45.148794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496eb5-3178-4850-91e2-60f3ebd898ee None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.149202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496eb5-3178-4850-91e2-60f3ebd898ee None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.149334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496eb5-3178-4850-91e2-60f3ebd898ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.168580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-5f496eb5-3178-4850-91e2-60f3ebd898ee None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:45.169874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5f496eb5-3178-4850-91e2-60f3ebd898ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:45.182524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 695/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:45.207939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ccd36-89a0-4001-b789-6d07fb8a606d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.208223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ccd36-89a0-4001-b789-6d07fb8a606d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.208753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ccd36-89a0-4001-b789-6d07fb8a606d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.210712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 676/1371] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:45.216480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c30f-0df4-43dd-be80-68772e11ec6f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.216987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c30f-0df4-43dd-be80-68772e11ec6f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.217122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c30f-0df4-43dd-be80-68772e11ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.223511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ccd36-89a0-4001-b789-6d07fb8a606d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:45.237279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1868c30f-0df4-43dd-be80-68772e11ec6f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:45.238353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ccd36-89a0-4001-b789-6d07fb8a606d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:45.238554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1868c30f-0df4-43dd-be80-68772e11ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:45.244053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:45.244783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.245244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.245516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.247167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 696/1372] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:45.254561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:45.256179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0beb-6b2e-4215-a935-0dd901a00de6 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:45.266581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 677/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:45.576585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75199-dc74-4e83-b225-52764cff0faa None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.576585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75199-dc74-4e83-b225-52764cff0faa None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.576585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75199-dc74-4e83-b225-52764cff0faa None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.576585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 697/1374] 10.222.0.26 () {54 vars in 963 bytes} [Thu May 5 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:45.577322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86558a87-0191-4f30-9963-253733fb992f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.578771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86558a87-0191-4f30-9963-253733fb992f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.578771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86558a87-0191-4f30-9963-253733fb992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.631459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-86558a87-0191-4f30-9963-253733fb992f None None] MFA Rules not processed for user `1b674fd55d7c4ea4bed85a42588278ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:45.632668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-86558a87-0191-4f30-9963-253733fb992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:45.705578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 678/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Thu May 5 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:45.713993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af75199-dc74-4e83-b225-52764cff0faa None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:45.725339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af75199-dc74-4e83-b225-52764cff0faa None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:45.729435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:45.730103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:45.730386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:45.730659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:45.739930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:45.741366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d7232-05b1-493b-a993-b395d4d1fd58 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:45.751709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 698/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:46:47.714604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b304-2644-4891-af18-985ed9384920 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:47.715496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b304-2644-4891-af18-985ed9384920 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:47.715774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b304-2644-4891-af18-985ed9384920 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:47.717482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 679/1377] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:47.722989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81091-4233-42e2-88c0-01482e81e2b6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:47.723537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81091-4233-42e2-88c0-01482e81e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:47.723537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81091-4233-42e2-88c0-01482e81e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:47.742898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2ba81091-4233-42e2-88c0-01482e81e2b6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:47.744107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2ba81091-4233-42e2-88c0-01482e81e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:47.752592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 699/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:47.797167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526b304-2644-4891-af18-985ed9384920 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:47.814064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526b304-2644-4891-af18-985ed9384920 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:47.819683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:47.820613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:47.820613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:47.821210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:47.829988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:47.831960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc10d-c1f6-4d84-bca8-edf6c803b11a service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:47.842107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 680/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:50.280863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcde91-61c6-426a-824e-3dc4b21f470a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:50.281384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcde91-61c6-426a-824e-3dc4b21f470a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:50.281384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcde91-61c6-426a-824e-3dc4b21f470a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:50.282803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 700/1380] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:50.287889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f8684-b0e0-4c3b-b6a8-c0b7591e1c1e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:50.288300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f8684-b0e0-4c3b-b6a8-c0b7591e1c1e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:50.288429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f8684-b0e0-4c3b-b6a8-c0b7591e1c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:50.306614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-487f8684-b0e0-4c3b-b6a8-c0b7591e1c1e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:50.307844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-487f8684-b0e0-4c3b-b6a8-c0b7591e1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:50.315724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 681/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:46:50.360169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcde91-61c6-426a-824e-3dc4b21f470a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:50.374471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcde91-61c6-426a-824e-3dc4b21f470a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:50.379999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:50.380637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:50.380915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:50.381185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:50.390472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:50.392061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433e2f-d18b-4ea6-b29c-0e3ade5ee696 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:50.403254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 701/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:52.828318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b598-c69d-4ee7-9380-9c2b54965a39 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:52.829227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b598-c69d-4ee7-9380-9c2b54965a39 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:52.829227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b598-c69d-4ee7-9380-9c2b54965a39 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:52.830574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 682/1383] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:52.835762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdeb-9fb7-43a4-9b58-18ee34353645 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:52.836164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdeb-9fb7-43a4-9b58-18ee34353645 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:52.836434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdeb-9fb7-43a4-9b58-18ee34353645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:52.855421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-13c8fdeb-9fb7-43a4-9b58-18ee34353645 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:52.856672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-13c8fdeb-9fb7-43a4-9b58-18ee34353645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:52.865061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 702/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:52.905961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b598-c69d-4ee7-9380-9c2b54965a39 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:52.920604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b598-c69d-4ee7-9380-9c2b54965a39 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:52.926042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:52.926673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:52.926952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:52.927223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:52.935552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:52.937118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb60aa9-1a1f-4d45-865c-90376ea295fb service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:52.946894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 683/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:55.208149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35eba-dcaf-4fa7-ae41-f777fc42f0e6 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:55.208839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35eba-dcaf-4fa7-ae41-f777fc42f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:55.208839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35eba-dcaf-4fa7-ae41-f777fc42f0e6 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:55.210116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 703/1386] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:55.215357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6156b-4be8-427d-a48e-04bd9be0102f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:55.215780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6156b-4be8-427d-a48e-04bd9be0102f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:55.215972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6156b-4be8-427d-a48e-04bd9be0102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:55.234423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-17c6156b-4be8-427d-a48e-04bd9be0102f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:55.235652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-17c6156b-4be8-427d-a48e-04bd9be0102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:55.244037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 684/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:46:55.288525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35eba-dcaf-4fa7-ae41-f777fc42f0e6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:55.305457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35eba-dcaf-4fa7-ae41-f777fc42f0e6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:55.312555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:55.313511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:55.313865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:55.314223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:55.324832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:55.326881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d36ce-ebef-435e-9bbf-a2c34d50c7e0 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:55.339329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 704/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:46:57.919087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd693-5db3-4269-9843-22d6b48d75a7 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:57.919633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd693-5db3-4269-9843-22d6b48d75a7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:57.919633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd693-5db3-4269-9843-22d6b48d75a7 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:57.921093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 685/1389] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:46:57.929092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575dbb-0347-4987-b432-30712a5f7a2d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:57.929505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575dbb-0347-4987-b432-30712a5f7a2d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:57.929673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf575dbb-0347-4987-b432-30712a5f7a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:57.948120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-cf575dbb-0347-4987-b432-30712a5f7a2d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:46:57.949476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cf575dbb-0347-4987-b432-30712a5f7a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:46:57.958322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 705/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:46:58.008153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fd693-5db3-4269-9843-22d6b48d75a7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:46:58.023108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fd693-5db3-4269-9843-22d6b48d75a7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:46:58.029347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:46:58.029989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:46:58.030292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:46:58.030601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:46:58.038672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:46:58.040252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e329a2-85c2-4beb-9754-b4f34a8f4986 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:46:58.049528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 686/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:00.584724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f462-f6e4-4139-a3dd-16fa672ccbe0 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:00.585342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f462-f6e4-4139-a3dd-16fa672ccbe0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:00.585342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f462-f6e4-4139-a3dd-16fa672ccbe0 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:00.586693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 706/1392] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:00.592589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bebd4b-2a81-42ae-8ac8-683cb0078d49 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:00.593039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bebd4b-2a81-42ae-8ac8-683cb0078d49 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:00.593178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bebd4b-2a81-42ae-8ac8-683cb0078d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:00.610847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-46bebd4b-2a81-42ae-8ac8-683cb0078d49 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:00.612012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-46bebd4b-2a81-42ae-8ac8-683cb0078d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:00.620187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 687/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:00.663870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f462-f6e4-4139-a3dd-16fa672ccbe0 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:00.678404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f462-f6e4-4139-a3dd-16fa672ccbe0 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:00.683860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:00.684495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:00.684778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:00.685051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:00.693119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:00.694728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549cc5-cdd2-4ae6-8905-0a46fa849d91 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:00.704683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 707/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:01.712915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fa59-6854-4750-93f1-c7488c0b0d2f None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:01.713486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fa59-6854-4750-93f1-c7488c0b0d2f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:01.713486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fa59-6854-4750-93f1-c7488c0b0d2f None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:01.715677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 688/1395] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:01.720572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45726d-6f21-4a58-abf7-efd7f28a28a3 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:01.720962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45726d-6f21-4a58-abf7-efd7f28a28a3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:01.721121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45726d-6f21-4a58-abf7-efd7f28a28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:01.738348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8d45726d-6f21-4a58-abf7-efd7f28a28a3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:01.739527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8d45726d-6f21-4a58-abf7-efd7f28a28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:01.747298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 708/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:01.803159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c856f7-807e-4ec6-b461-6d8d9059cd62 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:01.803461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c856f7-807e-4ec6-b461-6d8d9059cd62 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:01.803726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c856f7-807e-4ec6-b461-6d8d9059cd62 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:01.805081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 689/1397] 10.222.0.26 () {54 vars in 962 bytes} [Thu May 5 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:01.810500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0203e-5b06-4d41-8dcc-30a2495a20be None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:01.810874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0203e-5b06-4d41-8dcc-30a2495a20be None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:01.811214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0203e-5b06-4d41-8dcc-30a2495a20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:01.860423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-35b0203e-5b06-4d41-8dcc-30a2495a20be None None] MFA Rules not processed for user `53a21a1e87b44b35a3c82c69830b3b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:01.861613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-35b0203e-5b06-4d41-8dcc-30a2495a20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:01.919922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 709/1398] 10.222.0.26 () {58 vars in 1059 bytes} [Thu May 5 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:01.927412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c856f7-807e-4ec6-b461-6d8d9059cd62 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:01.937980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c856f7-807e-4ec6-b461-6d8d9059cd62 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:01.941580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:01.942247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:01.942532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:01.942809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:01.951669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:01.953102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2f601-1331-43dd-b458-084450081c5e service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:01.962886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 690/1399] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:02.507590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650218-56ba-4ad5-9af9-d84fb45d0c76 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:02.507878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650218-56ba-4ad5-9af9-d84fb45d0c76 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:02.508153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650218-56ba-4ad5-9af9-d84fb45d0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:02.556386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-dc650218-56ba-4ad5-9af9-d84fb45d0c76 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:02.557569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dc650218-56ba-4ad5-9af9-d84fb45d0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:02.621403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 710/1400] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:02.667697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278991-4597-45ff-9867-0b5499d20e8d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:02.667988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278991-4597-45ff-9867-0b5499d20e8d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:02.668268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278991-4597-45ff-9867-0b5499d20e8d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:02.669645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 691/1401] 10.222.0.26 () {54 vars in 942 bytes} [Thu May 5 13:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:02.676544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41bee-bf19-403e-8134-e60ec9f739dd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:02.676832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41bee-bf19-403e-8134-e60ec9f739dd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:02.677103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41bee-bf19-403e-8134-e60ec9f739dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:02.728803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-28e41bee-bf19-403e-8134-e60ec9f739dd None None] MFA Rules not processed for user `d5f07d46de6e48e19f316d764d86fd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:02.732735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-28e41bee-bf19-403e-8134-e60ec9f739dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:02.801321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 711/1402] 10.222.0.26 () {58 vars in 1039 bytes} [Thu May 5 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:02.811347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278991-4597-45ff-9867-0b5499d20e8d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:02.824902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278991-4597-45ff-9867-0b5499d20e8d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:02.830265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:02.830899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:02.831375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:02.831650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:02.839857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:02.841427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bc1f-4997-420e-a9c5-64a2ed8673ee service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:02.849314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 692/1403] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:47:03.130713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341b77-3ddf-4a85-96a1-f3dfdd91ccf1 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:03.131002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341b77-3ddf-4a85-96a1-f3dfdd91ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:03.131276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341b77-3ddf-4a85-96a1-f3dfdd91ccf1 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:03.132719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 712/1404] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:03.138358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858172-5fe3-444e-b7f0-0959a83144fc None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:03.140430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858172-5fe3-444e-b7f0-0959a83144fc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:03.140430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858172-5fe3-444e-b7f0-0959a83144fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:03.156891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c3858172-5fe3-444e-b7f0-0959a83144fc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:03.158106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c3858172-5fe3-444e-b7f0-0959a83144fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:03.165924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 693/1405] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:03.210398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341b77-3ddf-4a85-96a1-f3dfdd91ccf1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:03.225095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341b77-3ddf-4a85-96a1-f3dfdd91ccf1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:03.231602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:03.232277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:03.232555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:03.232824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:03.241657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:03.243275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc44e3-a950-467f-a49d-d446d9630203 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:03.253186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 713/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:05.735649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f410c1f-1b1c-40fa-b670-53ddd7b6ffd9 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:05.736193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f410c1f-1b1c-40fa-b670-53ddd7b6ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:05.736193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f410c1f-1b1c-40fa-b670-53ddd7b6ffd9 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:05.737556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 694/1407] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:05.742988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064cde-1140-4429-9985-3f5863c14d47 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:05.743448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064cde-1140-4429-9985-3f5863c14d47 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:05.743542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064cde-1140-4429-9985-3f5863c14d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:05.765368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fe064cde-1140-4429-9985-3f5863c14d47 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:05.766583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fe064cde-1140-4429-9985-3f5863c14d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:05.777762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 714/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:05.820044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f410c1f-1b1c-40fa-b670-53ddd7b6ffd9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:05.839917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f410c1f-1b1c-40fa-b670-53ddd7b6ffd9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:05.845637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:05.846300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:05.846757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:05.847029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:05.855809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:05.857490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b8ead-fcc9-47b0-88c6-9694bb2a7d33 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:05.879430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 695/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:27.617548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dcef-224e-4aba-8dfb-9a0b2fbfd2c7 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:27.618196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dcef-224e-4aba-8dfb-9a0b2fbfd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:27.618196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dcef-224e-4aba-8dfb-9a0b2fbfd2c7 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:27.620067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 715/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu May 5 13:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:27.625223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72486-9241-40aa-a727-b0f7bb8cb0d0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:27.625697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72486-9241-40aa-a727-b0f7bb8cb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:27.625810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72486-9241-40aa-a727-b0f7bb8cb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:27.644467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-dcf72486-9241-40aa-a727-b0f7bb8cb0d0 None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:27.645631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dcf72486-9241-40aa-a727-b0f7bb8cb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:27.653852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 696/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu May 5 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:47:27.668217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481c51-7f7a-48ae-bd04-b990e778410b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:27.668500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481c51-7f7a-48ae-bd04-b990e778410b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:27.668772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481c51-7f7a-48ae-bd04-b990e778410b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:27.670146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 716/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu May 5 13:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:27.674675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bd0c-f2b8-484e-bdbc-fd2eaccccf72 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:27.674958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bd0c-f2b8-484e-bdbc-fd2eaccccf72 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:27.675228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bd0c-f2b8-484e-bdbc-fd2eaccccf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:27.692085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b1e2bd0c-f2b8-484e-bdbc-fd2eaccccf72 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:27.693224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b1e2bd0c-f2b8-484e-bdbc-fd2eaccccf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:27.703558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 697/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu May 5 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:30.436353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e484c17-bb98-4f59-b7b4-0cc90fa10501 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:30.436882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e484c17-bb98-4f59-b7b4-0cc90fa10501 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:30.436882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e484c17-bb98-4f59-b7b4-0cc90fa10501 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:30.438272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:30.443455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45913688-f912-49a7-b90b-f9be6ab776a5 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:30.443883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45913688-f912-49a7-b90b-f9be6ab776a5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:30.443998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45913688-f912-49a7-b90b-f9be6ab776a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:30.462572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-45913688-f912-49a7-b90b-f9be6ab776a5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:30.463768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-45913688-f912-49a7-b90b-f9be6ab776a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:30.471668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:47:30.513730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e484c17-bb98-4f59-b7b4-0cc90fa10501 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:30.527754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e484c17-bb98-4f59-b7b4-0cc90fa10501 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:30.533102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:30.533727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:30.534003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:30.534299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:30.542358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:30.543936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bf70a-0ac3-44b4-b080-eaa15460dca3 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:30.553441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 718/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:31.845139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4191-6ccb-457d-9ec5-6c66fbe96fdc None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:31.845708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4191-6ccb-457d-9ec5-6c66fbe96fdc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:31.845708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4191-6ccb-457d-9ec5-6c66fbe96fdc None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:31.847119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:31.852121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5caf3-7069-453b-939d-8d872aed3f65 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:31.852528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5caf3-7069-453b-939d-8d872aed3f65 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:31.852676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5caf3-7069-453b-939d-8d872aed3f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:31.870673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-77e5caf3-7069-453b-939d-8d872aed3f65 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:31.871848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-77e5caf3-7069-453b-939d-8d872aed3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:31.879608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:32.055484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4191-6ccb-457d-9ec5-6c66fbe96fdc None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:32.070177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4191-6ccb-457d-9ec5-6c66fbe96fdc None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:32.076001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:32.076632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:32.076914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:32.077187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:32.085219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:32.086834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b27e2-c983-438a-9e62-2f9f7b11992b service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:32.096106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 700/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:33.374227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d206-35d3-456d-a7bc-8d4647c8db65 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:33.374776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d206-35d3-456d-a7bc-8d4647c8db65 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:33.374776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d206-35d3-456d-a7bc-8d4647c8db65 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:33.376035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:33.380983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bad2-e054-4a38-a566-8a19e29a281f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:33.381395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bad2-e054-4a38-a566-8a19e29a281f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:33.381529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9bad2-e054-4a38-a566-8a19e29a281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:33.399421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a7e9bad2-e054-4a38-a566-8a19e29a281f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:33.400632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a7e9bad2-e054-4a38-a566-8a19e29a281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:33.408306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:33.558275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d206-35d3-456d-a7bc-8d4647c8db65 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:33.572241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d206-35d3-456d-a7bc-8d4647c8db65 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:33.578309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:33.579203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:33.579479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:33.579750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:33.588794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:33.590493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45324b8b-4d45-4376-89b5-f144912b79a5 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:33.600377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 721/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:34.857420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e525-1c50-403d-b72f-8877845f2391 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:34.857964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e525-1c50-403d-b72f-8877845f2391 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:34.857964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e525-1c50-403d-b72f-8877845f2391 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:34.859411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:34.864170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef463a-1512-4778-b918-1d4961bd87e6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:34.864611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef463a-1512-4778-b918-1d4961bd87e6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:34.864711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef463a-1512-4778-b918-1d4961bd87e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:34.882667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-43ef463a-1512-4778-b918-1d4961bd87e6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:34.883869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-43ef463a-1512-4778-b918-1d4961bd87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:34.892147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:35.040916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e525-1c50-403d-b72f-8877845f2391 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:35.055273 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e525-1c50-403d-b72f-8877845f2391 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:35.060455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:35.061103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:35.061378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:35.061644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:35.069373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:35.070982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33422b17-34ce-40aa-a9cb-aa107c9a9173 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:35.080263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 703/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:36.336955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73ffa-ba31-42d3-bfdb-e21f1c49a612 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:36.337527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73ffa-ba31-42d3-bfdb-e21f1c49a612 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:36.337527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73ffa-ba31-42d3-bfdb-e21f1c49a612 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:36.339461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:36.344407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e54-6746-43ad-ad8c-208b90b38ff5 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:36.344821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e54-6746-43ad-ad8c-208b90b38ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:36.345012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e54-6746-43ad-ad8c-208b90b38ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:36.363165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-93fb5e54-6746-43ad-ad8c-208b90b38ff5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:36.364274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-93fb5e54-6746-43ad-ad8c-208b90b38ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:36.371919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:36.520573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73ffa-ba31-42d3-bfdb-e21f1c49a612 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:36.535279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73ffa-ba31-42d3-bfdb-e21f1c49a612 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:36.540545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:36.541738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:36.542104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:36.542343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:36.550220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:36.552176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4919c1-b6c5-42c2-a477-fed7454b50fa service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:36.561553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 724/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:37.814949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5806-0485-4c08-8977-10bc97890369 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:37.815491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5806-0485-4c08-8977-10bc97890369 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:37.815622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5806-0485-4c08-8977-10bc97890369 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:37.816914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:37.821721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5384-dcf4-46f9-b7fe-11902af03a2e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:37.822139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5384-dcf4-46f9-b7fe-11902af03a2e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:37.822951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5384-dcf4-46f9-b7fe-11902af03a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:37.848047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-bc1a5384-dcf4-46f9-b7fe-11902af03a2e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:37.849147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bc1a5384-dcf4-46f9-b7fe-11902af03a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:37.856808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:38.007165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5806-0485-4c08-8977-10bc97890369 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:38.021554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5806-0485-4c08-8977-10bc97890369 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:38.026814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:38.027431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:38.027707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:38.027977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:38.035751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:38.037343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260edb8-3e61-46a1-9bcd-8dedaa181d87 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:38.046400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 706/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:39.295383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414382-5e10-4f35-96ed-22b55e0fb8b3 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:39.295952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414382-5e10-4f35-96ed-22b55e0fb8b3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:39.295952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414382-5e10-4f35-96ed-22b55e0fb8b3 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:39.297343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:39.302160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff722-53e2-49d3-9eea-6e0f8aa71360 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:39.302555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff722-53e2-49d3-9eea-6e0f8aa71360 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:39.302713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff722-53e2-49d3-9eea-6e0f8aa71360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:39.320479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-40bff722-53e2-49d3-9eea-6e0f8aa71360 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:39.321667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-40bff722-53e2-49d3-9eea-6e0f8aa71360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:39.330104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:39.478905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1414382-5e10-4f35-96ed-22b55e0fb8b3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:39.492834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1414382-5e10-4f35-96ed-22b55e0fb8b3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:39.498767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:39.499391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:39.499669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:39.499943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:39.507796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:39.509377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0380e0-3f4d-435f-a1d2-3b6717f46e8e service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:39.519057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 727/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:40.797707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150308a-c6d8-4ca9-aa3b-a994313290dc None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:40.798300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150308a-c6d8-4ca9-aa3b-a994313290dc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:40.798300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150308a-c6d8-4ca9-aa3b-a994313290dc None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:40.799686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:40.804362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f66f-965f-4864-b080-338c0bff3a41 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:40.804741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f66f-965f-4864-b080-338c0bff3a41 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:40.804901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f66f-965f-4864-b080-338c0bff3a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:40.823620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c478f66f-965f-4864-b080-338c0bff3a41 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:40.824790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c478f66f-965f-4864-b080-338c0bff3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:40.832985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:40.989865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150308a-c6d8-4ca9-aa3b-a994313290dc None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:41.003735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150308a-c6d8-4ca9-aa3b-a994313290dc None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:41.008932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:41.009553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:41.009904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:41.010220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:41.018107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:41.019674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77626f0c-38f9-4b1c-bef2-6d4620ec2433 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:41.029204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 709/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:42.305795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aec67-4c8d-4647-a00d-3c65e744ebbc None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:42.306399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aec67-4c8d-4647-a00d-3c65e744ebbc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:42.306399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aec67-4c8d-4647-a00d-3c65e744ebbc None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:42.308245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:42.313172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4f1a-fd3b-4617-9825-102a72ca5277 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:42.313620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4f1a-fd3b-4617-9825-102a72ca5277 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:42.313719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4f1a-fd3b-4617-9825-102a72ca5277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:42.331892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-095e4f1a-fd3b-4617-9825-102a72ca5277 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:42.333058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-095e4f1a-fd3b-4617-9825-102a72ca5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:42.342274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:42.489215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aec67-4c8d-4647-a00d-3c65e744ebbc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:42.503814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aec67-4c8d-4647-a00d-3c65e744ebbc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:42.509336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:42.510555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:42.510835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:42.511104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:42.519207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:42.520778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf9ea-9983-4850-b299-4e6108cb619f service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:42.529913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 730/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:44.660920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f2c4-7a3e-49d0-a8be-7cb7adab27ac None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:44.661456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f2c4-7a3e-49d0-a8be-7cb7adab27ac None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:44.661456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f2c4-7a3e-49d0-a8be-7cb7adab27ac None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:44.662865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:44.668478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddcf7d-08e5-4ef9-8ba4-4f5357775755 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:44.668910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddcf7d-08e5-4ef9-8ba4-4f5357775755 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:44.669044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddcf7d-08e5-4ef9-8ba4-4f5357775755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:44.686686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-31ddcf7d-08e5-4ef9-8ba4-4f5357775755 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:44.687858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-31ddcf7d-08e5-4ef9-8ba4-4f5357775755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:44.695582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:44.735105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f2c4-7a3e-49d0-a8be-7cb7adab27ac None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:44.745464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f2c4-7a3e-49d0-a8be-7cb7adab27ac None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:44.748882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:44.749503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:44.749783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:44.750079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:44.758627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:44.760072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef438d2-278b-40f5-8234-ff15412b9edc service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:44.769149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 712/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:47.156097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356798bd-2216-4654-b22a-2d9a12f959e5 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:47.156659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356798bd-2216-4654-b22a-2d9a12f959e5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:47.156659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356798bd-2216-4654-b22a-2d9a12f959e5 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:47.158035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:47.163397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02ce3-0b23-4e4c-b465-20a2de10a0bc None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:47.163861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02ce3-0b23-4e4c-b465-20a2de10a0bc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:47.163972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02ce3-0b23-4e4c-b465-20a2de10a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:47.181380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-54e02ce3-0b23-4e4c-b465-20a2de10a0bc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:47.183199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-54e02ce3-0b23-4e4c-b465-20a2de10a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:47.190751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:47.227513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356798bd-2216-4654-b22a-2d9a12f959e5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:47.239346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356798bd-2216-4654-b22a-2d9a12f959e5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:47.242852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:47.243476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:47.243754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:47.244121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:47.252738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:47.254193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297651-f6c8-4038-9cf8-e34dfa9e8fb9 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:47.263893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 733/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:49.927544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7c33-7730-4211-8561-152ee8ab3dce None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:49.928102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7c33-7730-4211-8561-152ee8ab3dce None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:49.928102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7c33-7730-4211-8561-152ee8ab3dce None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:49.929464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:49.935271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b605-82f4-4361-87f7-a6a53484b869 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:49.935716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b605-82f4-4361-87f7-a6a53484b869 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:49.935825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b605-82f4-4361-87f7-a6a53484b869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:49.953368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c295b605-82f4-4361-87f7-a6a53484b869 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:49.954827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c295b605-82f4-4361-87f7-a6a53484b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:49.962380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:49.999993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7c33-7730-4211-8561-152ee8ab3dce None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:50.010890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7c33-7730-4211-8561-152ee8ab3dce None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:50.014344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:50.014962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:50.015236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:50.015502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:50.027721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:50.029919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9f05-9450-41bd-8098-61b550b81f8e service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:50.043549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 715/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:52.462223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e74f8-aa52-403a-8541-31bac2abbafc None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:52.463343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e74f8-aa52-403a-8541-31bac2abbafc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:52.463343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e74f8-aa52-403a-8541-31bac2abbafc None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:52.464878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:52.470037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4c6e1-fd79-415e-912a-2421b1664694 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:52.470436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4c6e1-fd79-415e-912a-2421b1664694 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:52.470595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4c6e1-fd79-415e-912a-2421b1664694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:52.487711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-09b4c6e1-fd79-415e-912a-2421b1664694 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:52.488892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-09b4c6e1-fd79-415e-912a-2421b1664694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:52.496535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:52.534603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e74f8-aa52-403a-8541-31bac2abbafc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:52.544886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e74f8-aa52-403a-8541-31bac2abbafc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:52.548316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:52.548931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:52.549205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:52.549476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:52.557904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:52.559340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3441-3dac-4f51-b247-590abeee3803 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:52.568268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 736/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:54.860227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:54.860793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:54.860793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:54.862218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:54.867481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af9a-dd2e-4315-a2dc-4a1d517db426 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:54.867885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af9a-dd2e-4315-a2dc-4a1d517db426 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:54.868028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af9a-dd2e-4315-a2dc-4a1d517db426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:54.885636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6bb6af9a-dd2e-4315-a2dc-4a1d517db426 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:54.886829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6bb6af9a-dd2e-4315-a2dc-4a1d517db426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:54.894480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:54.933093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:54.934830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:54.947938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7971-5786-413d-8cf3-51d1ba800cde None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:54.951351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:54.951977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:54.952260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:54.952531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:54.961413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:54.963506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc62d1-8485-4b27-9c02-2238a452f1e5 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:54.972588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 718/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:57.316554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638345-efca-466a-bb28-e11be9e900ff None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:57.317132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638345-efca-466a-bb28-e11be9e900ff None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:57.317132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638345-efca-466a-bb28-e11be9e900ff None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:57.318509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:57.323746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a323-2a22-4509-955e-cbbf27cd5bb2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:57.324124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a323-2a22-4509-955e-cbbf27cd5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:57.324302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a323-2a22-4509-955e-cbbf27cd5bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:57.342274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0149a323-2a22-4509-955e-cbbf27cd5bb2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:57.343458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0149a323-2a22-4509-955e-cbbf27cd5bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:57.351225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:57.389483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638345-efca-466a-bb28-e11be9e900ff None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:57.402655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638345-efca-466a-bb28-e11be9e900ff None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:57.406170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:57.406807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:57.407088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:57.407362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:57.420887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:57.422362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed211d-854f-4300-9df0-878132cea155 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:57.432935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 739/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:47:59.762193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87e4c-75d0-40f7-87ad-ca6c5cf5478e None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:59.762756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87e4c-75d0-40f7-87ad-ca6c5cf5478e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:59.762756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87e4c-75d0-40f7-87ad-ca6c5cf5478e None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:59.764140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:47:59.769439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448fbed-2e1b-40b2-9da0-75554af47481 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:59.769851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448fbed-2e1b-40b2-9da0-75554af47481 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:59.769988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448fbed-2e1b-40b2-9da0-75554af47481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:59.787769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3448fbed-2e1b-40b2-9da0-75554af47481 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:47:59.788944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3448fbed-2e1b-40b2-9da0-75554af47481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:47:59.797343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:47:59.833488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87e4c-75d0-40f7-87ad-ca6c5cf5478e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:47:59.844408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87e4c-75d0-40f7-87ad-ca6c5cf5478e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:47:59.851952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:47:59.852607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:47:59.852884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:47:59.853755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:47:59.863232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:47:59.864666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4484c4-4227-4769-b832-02a015716409 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:47:59.874071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 721/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:02.163672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4af7-d80a-41fd-bddf-a40ab57f05ff None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:02.164165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4af7-d80a-41fd-bddf-a40ab57f05ff None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:02.164264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4af7-d80a-41fd-bddf-a40ab57f05ff None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:02.166158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:02.171388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875df2-2da8-4fa4-9ebb-24660bb94fc4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:02.171797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875df2-2da8-4fa4-9ebb-24660bb94fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:02.171933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875df2-2da8-4fa4-9ebb-24660bb94fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:02.189744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-39875df2-2da8-4fa4-9ebb-24660bb94fc4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:02.190964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-39875df2-2da8-4fa4-9ebb-24660bb94fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:02.198700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:02.235224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4af7-d80a-41fd-bddf-a40ab57f05ff None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:02.245690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4af7-d80a-41fd-bddf-a40ab57f05ff None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:02.249190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:02.249812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:02.250126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:02.250399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:02.258971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:02.260922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132072c-b991-4be9-9650-3642602e8a6a service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:02.269951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 742/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:04.506169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434f6a-c612-4f9a-8b34-0e8c7dd5a5bd None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:04.506755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434f6a-c612-4f9a-8b34-0e8c7dd5a5bd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:04.506755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434f6a-c612-4f9a-8b34-0e8c7dd5a5bd None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:04.508161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:04.513800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef62a-933e-4d6a-9516-7ee144910fe2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:04.514264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef62a-933e-4d6a-9516-7ee144910fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:04.514516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef62a-933e-4d6a-9516-7ee144910fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:04.532353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ba5ef62a-933e-4d6a-9516-7ee144910fe2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:04.533545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ba5ef62a-933e-4d6a-9516-7ee144910fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:04.541883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:04.577902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22434f6a-c612-4f9a-8b34-0e8c7dd5a5bd None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:04.589061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22434f6a-c612-4f9a-8b34-0e8c7dd5a5bd None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:04.592530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:04.593156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:04.593432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:04.593700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:04.602230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:04.603642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688429b8-2927-4313-928c-004ec0cc6cfd service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:04.612682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 724/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:06.897673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4afd30-615a-4c55-a324-9cafa8bb3304 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:06.898286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4afd30-615a-4c55-a324-9cafa8bb3304 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:06.898286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4afd30-615a-4c55-a324-9cafa8bb3304 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:06.900483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:06.905367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b98ce-28ec-404d-893c-82ae4f2a9103 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:06.905789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b98ce-28ec-404d-893c-82ae4f2a9103 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:06.905898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b98ce-28ec-404d-893c-82ae4f2a9103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:06.923160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-388b98ce-28ec-404d-893c-82ae4f2a9103 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:06.924333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-388b98ce-28ec-404d-893c-82ae4f2a9103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:06.932063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:06.968666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4afd30-615a-4c55-a324-9cafa8bb3304 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:06.979262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4afd30-615a-4c55-a324-9cafa8bb3304 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:06.982938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:06.983589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:06.983864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:06.984133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:06.992941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:06.994416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dc69c-b224-434a-89bb-9a0aaf72c53a service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:07.003721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 745/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:40.507589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177fb-b20f-4b5b-8f78-cf8609a01d54 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:40.508688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177fb-b20f-4b5b-8f78-cf8609a01d54 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:40.508688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177fb-b20f-4b5b-8f78-cf8609a01d54 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:40.510252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 726/1471] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:40.515256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7b8-f4cf-4c50-a824-448e2353c31d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:40.515668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7b8-f4cf-4c50-a824-448e2353c31d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:40.515804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7b8-f4cf-4c50-a824-448e2353c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:40.534001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-07c0b7b8-f4cf-4c50-a824-448e2353c31d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:40.535186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-07c0b7b8-f4cf-4c50-a824-448e2353c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:40.543369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 746/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:40.589732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9c26-f4e0-4e82-8767-bcd2f446c04d None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:40.590040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9c26-f4e0-4e82-8767-bcd2f446c04d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:40.590317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9c26-f4e0-4e82-8767-bcd2f446c04d None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:40.591661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 727/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu May 5 13:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:40.596375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0bcd-f267-4442-9056-4a3ee81c9c90 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:40.596666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0bcd-f267-4442-9056-4a3ee81c9c90 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:40.596945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0bcd-f267-4442-9056-4a3ee81c9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:40.614945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-cfed0bcd-f267-4442-9056-4a3ee81c9c90 None None] MFA Rules not processed for user `53a21a1e87b44b35a3c82c69830b3b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:40.616107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cfed0bcd-f267-4442-9056-4a3ee81c9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:40.623086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 747/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu May 5 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:40.630127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a9c26-f4e0-4e82-8767-bcd2f446c04d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:40.640615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a9c26-f4e0-4e82-8767-bcd2f446c04d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:40.644056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:40.644668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:40.644943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:40.645212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:40.653769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:40.655216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a573d-b4cd-4eeb-8688-16a1eacc73ea service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:40.664245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 728/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:48:42.966840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83c34-3407-4610-b5e3-38742b001b84 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:42.967409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83c34-3407-4610-b5e3-38742b001b84 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:42.967409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83c34-3407-4610-b5e3-38742b001b84 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:42.968734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 748/1476] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:42.973762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3d30-ad01-4a40-b757-17c28d67b07e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:42.974184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3d30-ad01-4a40-b757-17c28d67b07e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:42.974378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3d30-ad01-4a40-b757-17c28d67b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:42.991870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2bfa3d30-ad01-4a40-b757-17c28d67b07e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:42.993176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2bfa3d30-ad01-4a40-b757-17c28d67b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:43.000921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 729/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:43.024877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83c34-3407-4610-b5e3-38742b001b84 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:43.036804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83c34-3407-4610-b5e3-38742b001b84 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:43.041180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:43.041803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:43.042105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:43.042374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:43.043090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:43.044812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:48:43.044812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:48:43.044812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:48:43.045937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a48f8-2d0b-4ebc-9137-b4cb919abd86 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:43.064656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 749/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu May 5 13:48:43 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:48:45.301688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee3e10-e739-412b-8bf7-711b5eb54bd7 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:45.302300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee3e10-e739-412b-8bf7-711b5eb54bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:45.302300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee3e10-e739-412b-8bf7-711b5eb54bd7 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:45.303670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 730/1479] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:45.308829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6283b8-0d60-4672-bdfe-ed5db3560e3b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:45.309252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6283b8-0d60-4672-bdfe-ed5db3560e3b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:45.309366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6283b8-0d60-4672-bdfe-ed5db3560e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:45.326683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-cc6283b8-0d60-4672-bdfe-ed5db3560e3b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:45.327850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cc6283b8-0d60-4672-bdfe-ed5db3560e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:45.335740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 750/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:45.377537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee3e10-e739-412b-8bf7-711b5eb54bd7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:45.391519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee3e10-e739-412b-8bf7-711b5eb54bd7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:45.396710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:45.397327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:45.397603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:45.397871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:45.406192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:45.407754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec88e53-7d92-474b-bb1b-ce111c340d01 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:45.417322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 731/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:47.838758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a343-e0bc-40c4-b5ae-d86cfeaaf60d None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:47.839320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a343-e0bc-40c4-b5ae-d86cfeaaf60d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:47.839320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a343-e0bc-40c4-b5ae-d86cfeaaf60d None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:47.840666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 751/1482] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:47.845770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9c77-adde-4d13-9da6-d039b167a039 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:47.846309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9c77-adde-4d13-9da6-d039b167a039 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:47.846428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9c77-adde-4d13-9da6-d039b167a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:47.864023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-183d9c77-adde-4d13-9da6-d039b167a039 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:47.865219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-183d9c77-adde-4d13-9da6-d039b167a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:47.872777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 732/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:48:47.913414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02a343-e0bc-40c4-b5ae-d86cfeaaf60d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:47.921899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02a343-e0bc-40c4-b5ae-d86cfeaaf60d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:47.925452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:47.926115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:47.926396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:47.926668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:47.935854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:47.937292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434af3-67eb-40f4-8566-2a723c3961a9 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:47.950572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 752/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:50.236721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056456b-c058-4288-8ca4-cd3a0f67ac75 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:50.237307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056456b-c058-4288-8ca4-cd3a0f67ac75 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:50.237307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056456b-c058-4288-8ca4-cd3a0f67ac75 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:50.238739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 733/1485] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:50.243854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7691-966a-4ee5-9716-b9a3759c3360 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:50.244342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7691-966a-4ee5-9716-b9a3759c3360 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:50.244451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e7691-966a-4ee5-9716-b9a3759c3360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:50.262261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8f9e7691-966a-4ee5-9716-b9a3759c3360 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:50.263443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8f9e7691-966a-4ee5-9716-b9a3759c3360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:50.271257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 753/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:50.308922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056456b-c058-4288-8ca4-cd3a0f67ac75 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:50.319296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056456b-c058-4288-8ca4-cd3a0f67ac75 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:50.323479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:50.324114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:50.324395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:50.324666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:50.333653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:50.335118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db0a6f-3576-4db6-8011-4f45e4bbd7b6 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:50.344830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 734/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:48:52.720479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c99-17b6-4505-aa6c-697451e974f2 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:52.721049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c99-17b6-4505-aa6c-697451e974f2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:52.721049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c99-17b6-4505-aa6c-697451e974f2 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:52.722435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 754/1488] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:52.727571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf809ef-90a5-4686-8d65-fcadb96a835c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:52.727994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf809ef-90a5-4686-8d65-fcadb96a835c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:52.728107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf809ef-90a5-4686-8d65-fcadb96a835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:52.745704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8bf809ef-90a5-4686-8d65-fcadb96a835c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:52.746919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8bf809ef-90a5-4686-8d65-fcadb96a835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:52.754586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 735/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:52.794973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2c99-17b6-4505-aa6c-697451e974f2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:52.806259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2c99-17b6-4505-aa6c-697451e974f2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:52.809840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:52.810500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:52.810776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:52.811046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:52.819951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:52.821981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea45cf9-f312-4a84-a873-b3928e3c9f29 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:52.831854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 755/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:48:55.416394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771371-543a-4e07-8e0b-6868ed4f93a4 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:55.416938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771371-543a-4e07-8e0b-6868ed4f93a4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:55.416938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771371-543a-4e07-8e0b-6868ed4f93a4 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:55.418266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 736/1491] 10.222.0.26 () {54 vars in 926 bytes} [Thu May 5 13:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:48:55.423461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d524-e6a7-400e-a2b0-004cb16a3bca None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:55.423901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d524-e6a7-400e-a2b0-004cb16a3bca None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:55.424010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d524-e6a7-400e-a2b0-004cb16a3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:55.441058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f895d524-e6a7-400e-a2b0-004cb16a3bca None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:48:55.442289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f895d524-e6a7-400e-a2b0-004cb16a3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:48:55.450351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 756/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu May 5 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:48:55.488503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771371-543a-4e07-8e0b-6868ed4f93a4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:48:55.498901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771371-543a-4e07-8e0b-6868ed4f93a4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:48:55.502381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:48:55.502998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:48:55.503272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:48:55.503538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:48:55.512708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:48:55.514146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b9d8-0f0d-48a0-87be-c304e0f5a403 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:48:55.523453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 737/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:50:32.014306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.014895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.014895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.032826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:50:32.034007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:32.042407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 757/1494] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:50:32.049801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358837-6e87-4789-937f-5523131ef68e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.050288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358837-6e87-4789-937f-5523131ef68e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.050396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358837-6e87-4789-937f-5523131ef68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.067406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8d358837-6e87-4789-937f-5523131ef68e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:50:32.068556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8d358837-6e87-4789-937f-5523131ef68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:32.076628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 738/1495] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:50:32.081016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.090820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6f86b-c001-49ed-abb5-e399f23dde24 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.095339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.095992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.096268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:50:32.098624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:50:32.099443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.110921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 758/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:50:32.118831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d358837-6e87-4789-937f-5523131ef68e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.127760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d358837-6e87-4789-937f-5523131ef68e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.132764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.133412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.133691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.133960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.134679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.136438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.136438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:50:32.136438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:50:32.137729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.287965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 739/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:50:32 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:50:32.292046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.301722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9bafd-8020-465c-b014-8c2fa35b707f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.355109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.355773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.356053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.356324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.357018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.358085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.358085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:50:32.358085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:50:32.359288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.423947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 759/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:50:32 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:50:32.428025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.438295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7d9f0-580f-40bf-83e1-9f3da166a893 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.442849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.443497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.443774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.444044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.445344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.446387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.446387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:50:32.446387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:50:32.447296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.459954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 740/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:50:32.464398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.473881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bde45c-8c04-4f61-86a2-4ab4daece973 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.478280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.478923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.479199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.479465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.480175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.481204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.481204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:50:32.481204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:50:32.482090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47ac8-f3d0-4a2e-805f-52c2208eb780 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.495199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 760/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:50:32.499082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.509225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e6fb-ebe2-4239-9878-f1662e5ab380 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.513828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.516209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.516209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.516209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] PATH_INFO: `/v3/projects/4fedea0be9514877b61dced39738d8b5/users/b0ecdbab375b4bb28792171162e9b3d2/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.530172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fedea0be9514877b61dced39738d8b5, user_id=b0ecdbab375b4bb28792171162e9b3d2, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.531188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.531188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:50:32.531188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:50:32.533109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.589231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 741/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:50:32 2022] PUT /identity/v3/projects/4fedea0be9514877b61dced39738d8b5/users/b0ecdbab375b4bb28792171162e9b3d2/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:50:32.600586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759bd3-1e18-42e0-8bc2-f2e97a728220 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.600867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759bd3-1e18-42e0-8bc2-f2e97a728220 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.601141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759bd3-1e18-42e0-8bc2-f2e97a728220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.627860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ee759bd3-1e18-42e0-8bc2-f2e97a728220 None None] MFA Rules not processed for user `b0ecdbab375b4bb28792171162e9b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:50:32.629046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ee759bd3-1e18-42e0-8bc2-f2e97a728220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:32.704075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 761/1502] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:50:32.715432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.783998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8a842-b7b4-4e93-8135-18e9e14ba7d0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.789422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.790085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.790368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.790641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.798286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.804737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:32.809153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 742/1503] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:50:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:50:32.879792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894879-d1e9-4029-ba48-597fcd351430 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.880106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894879-d1e9-4029-ba48-597fcd351430 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.880391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894879-d1e9-4029-ba48-597fcd351430 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.881667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 762/1504] 10.222.0.26 () {52 vars in 829 bytes} [Thu May 5 13:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:50:32.885173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:32.944167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5253-cc4c-4cd0-945e-329e8adcfe12 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:32.948601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:32.949445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:32.949716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:32.949979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] PATH_INFO: `/v3/users/b0ecdbab375b4bb28792171162e9b3d2` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:32.951170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ecdbab375b4bb28792171162e9b3d2)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:32.952171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:32.952171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:50:32.952171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:50:32.953348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:33.195885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ecdbab375b4bb28792171162e9b3d2'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:33.208129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ecdbab375b4bb28792171162e9b3d2'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:33.208860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ecdbab375b4bb28792171162e9b3d2'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:33.209481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ecdbab375b4bb28792171162e9b3d2'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:33.275101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ecdbab375b4bb28792171162e9b3d2'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:33.300512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 743/1505] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:50:32 2022] DELETE /identity/v3/users/b0ecdbab375b4bb28792171162e9b3d2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:50:33.305151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:33.305642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:33.305765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:33.325488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:50:33.326662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:33.381933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 763/1506] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:50:33.391370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:33.392750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:33.447702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca7b3e-7196-498c-b957-4edb4dde3386 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:33.451253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:33.451891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:33.452172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:33.452446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:33.461848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:33.463314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4465d9-23b8-4a6b-8c41-1b5102f07cb1 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:33.472403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 744/1507] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:50:33.979866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:50:33.981489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:50:33.993362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4bf2d-0fa1-44de-bcd2-2e767842ebab None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:50:33.997942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:50:34.000039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:50:34.000314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:50:34.000710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] PATH_INFO: `/v3/projects/4fedea0be9514877b61dced39738d8b5` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:50:34.001906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fedea0be9514877b61dced39738d8b5)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:50:34.002952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:50:34.002952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:50:34.002952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:50:34.004473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:50:34.131167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fedea0be9514877b61dced39738d8b5', 'request_id': 'req-666fe2b4-9373-4182-83b2-c7fe632af218'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:34.137647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fedea0be9514877b61dced39738d8b5', 'request_id': 'req-666fe2b4-9373-4182-83b2-c7fe632af218'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:34.218064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fedea0be9514877b61dced39738d8b5', 'request_id': 'req-666fe2b4-9373-4182-83b2-c7fe632af218'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:34.236594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] The token cache is being invalidate because project 4fedea0be9514877b61dced39738d8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:50:34.236819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:34.237453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-666fe2b4-9373-4182-83b2-c7fe632af218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:50:34.239111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 764/1508] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:50:33 2022] DELETE /identity/v3/projects/4fedea0be9514877b61dced39738d8b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:52:13.411437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:13.412013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:13.412013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:13.413275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 745/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:13.418123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ef74-12f6-4e0f-97e8-d3ab19a40e6c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:13.418516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ef74-12f6-4e0f-97e8-d3ab19a40e6c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:13.418679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ef74-12f6-4e0f-97e8-d3ab19a40e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:13.436171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b0e8ef74-12f6-4e0f-97e8-d3ab19a40e6c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:13.437358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b0e8ef74-12f6-4e0f-97e8-d3ab19a40e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:13.494407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 765/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:13.649788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:13.651507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:13.725538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febb15-f046-47fb-94e7-bca14f0891f2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:13.730875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:13.731517 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:13.731800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:13.732074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:13.740160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:13.741764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf294-4f0b-440b-afc1-677a170bfa65 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:13.751690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 746/1511] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:14.264479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5dbee-db59-473d-b219-962caefbd07f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:14.265020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5dbee-db59-473d-b219-962caefbd07f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:14.265328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5dbee-db59-473d-b219-962caefbd07f None None] PATH_INFO: `/v3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:14.266949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 766/1512] 10.222.0.41 () {54 vars in 925 bytes} [Thu May 5 13:52:14 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:52:14.273184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b787-f5c3-4287-a609-df6f6eb10be9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:14.273498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b787-f5c3-4287-a609-df6f6eb10be9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:14.273783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b787-f5c3-4287-a609-df6f6eb10be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:14.291734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-2043b787-f5c3-4287-a609-df6f6eb10be9 None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:14.292951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2043b787-f5c3-4287-a609-df6f6eb10be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:14.353775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 747/1513] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 5 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:15.014480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af314-09fe-4ff1-bcad-06c056fd283b None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:15.015043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af314-09fe-4ff1-bcad-06c056fd283b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:15.015043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af314-09fe-4ff1-bcad-06c056fd283b None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:15.016393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:15.021146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a51c4-a4e0-4e99-b4c0-9b07c7b41bb3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:15.021554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a51c4-a4e0-4e99-b4c0-9b07c7b41bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:15.021704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a51c4-a4e0-4e99-b4c0-9b07c7b41bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:15.039452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b69a51c4-a4e0-4e99-b4c0-9b07c7b41bb3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:15.040635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b69a51c4-a4e0-4e99-b4c0-9b07c7b41bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:15.048374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:15.199143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af314-09fe-4ff1-bcad-06c056fd283b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:15.214294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af314-09fe-4ff1-bcad-06c056fd283b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:15.219604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:15.220236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:15.220517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:15.220793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:15.228651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:15.230284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f3cf6-a3be-47ca-8a47-d0e002842cd4 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:15.239386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 768/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:18.397752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b8b0-a0bd-45d2-b6b8-872513840a84 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:18.398296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b8b0-a0bd-45d2-b6b8-872513840a84 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:18.398409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b8b0-a0bd-45d2-b6b8-872513840a84 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:18.399742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 749/1517] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:18.405503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd9c-839e-48ad-b00a-50dcff13097c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:18.405929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd9c-839e-48ad-b00a-50dcff13097c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:18.406169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd9c-839e-48ad-b00a-50dcff13097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:18.424730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7b36bd9c-839e-48ad-b00a-50dcff13097c None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:18.425912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7b36bd9c-839e-48ad-b00a-50dcff13097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:18.434308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 769/1518] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:52:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:18.442298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b8b0-a0bd-45d2-b6b8-872513840a84 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:18.455262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b8b0-a0bd-45d2-b6b8-872513840a84 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:18.460255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:18.460870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:18.461146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:18.461413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:18.469335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:18.470922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b7735-45f2-44c2-9976-e07f54d54301 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:18.480185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 750/1519] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:26.876494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6012-6ac1-4418-a35a-046cfbbd957c None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:26.877132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6012-6ac1-4418-a35a-046cfbbd957c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:26.877132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6012-6ac1-4418-a35a-046cfbbd957c None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:26.878429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 770/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:26.883217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978630-9f99-491b-b224-f350e06256ae None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:26.883780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978630-9f99-491b-b224-f350e06256ae None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:26.883780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20978630-9f99-491b-b224-f350e06256ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:26.902976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-20978630-9f99-491b-b224-f350e06256ae None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:26.904804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-20978630-9f99-491b-b224-f350e06256ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:26.912706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 751/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:27.064209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6012-6ac1-4418-a35a-046cfbbd957c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:27.078784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6012-6ac1-4418-a35a-046cfbbd957c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:27.084395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:27.085023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:27.085302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:27.085577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:27.093874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:27.095526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b462a55-a509-4fe7-bbe1-5b97b7a2a33d service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:27.105209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 771/1522] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:28.335980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff978f4-3bcd-479e-bb9d-df80f51d05e4 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:28.336549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff978f4-3bcd-479e-bb9d-df80f51d05e4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:28.336549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff978f4-3bcd-479e-bb9d-df80f51d05e4 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:28.337912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 752/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 13:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:52:28.343318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689780-c0fb-43e4-8540-93caa908e693 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:28.343736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689780-c0fb-43e4-8540-93caa908e693 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:28.343889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689780-c0fb-43e4-8540-93caa908e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:28.361165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f9689780-c0fb-43e4-8540-93caa908e693 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:28.362289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f9689780-c0fb-43e4-8540-93caa908e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:28.370170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 772/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:28.519823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff978f4-3bcd-479e-bb9d-df80f51d05e4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:28.534041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff978f4-3bcd-479e-bb9d-df80f51d05e4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:28.539410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:28.540038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:28.540318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:28.540591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:28.548509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:28.550111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b2bb1-570c-4813-b4a7-caab729446cb service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:28.559298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 753/1525] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:32.857015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:32.857556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:32.857556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:32.858984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 773/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:32.864102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93565-c959-49af-a383-c9876c3b2902 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:32.864516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93565-c959-49af-a383-c9876c3b2902 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:32.864652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93565-c959-49af-a383-c9876c3b2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:32.882066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8fd93565-c959-49af-a383-c9876c3b2902 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:32.883239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8fd93565-c959-49af-a383-c9876c3b2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:32.891466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 754/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:32.926828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:32.928492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:32.983127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac2e91-2916-4dde-960f-5957e4cc13ce None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:32.986526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:32.987148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:32.987421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:32.987685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:32.996177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:32.998128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df7e19-0d7a-48c0-9ddb-ab7a2aa618ba service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:33.007064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 774/1528] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:35.256145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:35.256701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:35.256701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:35.258093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 755/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:35.263136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b12a2-f840-4dd9-8645-7b45be950a82 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:35.263531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b12a2-f840-4dd9-8645-7b45be950a82 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:35.263681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b12a2-f840-4dd9-8645-7b45be950a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:35.281612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1a4b12a2-f840-4dd9-8645-7b45be950a82 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:35.282815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1a4b12a2-f840-4dd9-8645-7b45be950a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:35.290424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 775/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:52:35.325993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:35.327669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:35.340686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe9a-5d99-41da-8768-9ab8f9a298b2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:35.344731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:35.345361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:35.345644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:35.345921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:35.355192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:35.356149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bf4d8-58a8-436e-9729-0a929a1f0ef2 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:35.366373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 756/1531] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:38.987115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:38.987679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:38.987679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:38.989059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 776/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:52:38.994355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7167-f70c-4ec3-b78a-26c6c028a589 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:38.994779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7167-f70c-4ec3-b78a-26c6c028a589 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:38.994896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7167-f70c-4ec3-b78a-26c6c028a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:39.013427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4b2e7167-f70c-4ec3-b78a-26c6c028a589 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:39.014636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4b2e7167-f70c-4ec3-b78a-26c6c028a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:39.022328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 757/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:39.291999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:39.293648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:39.348304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9472a80-f2ff-48f7-8518-3961106cca9c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:39.352037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:39.352624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:39.352904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:39.353174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:39.362596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:39.364027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a577655-4cc4-4616-be18-cd00c6f46e8f service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:39.373744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 777/1534] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:52:41.690963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e46b-dc7c-4eb4-b2ba-61b19250ba2b None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:41.691495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e46b-dc7c-4eb4-b2ba-61b19250ba2b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:41.691595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e46b-dc7c-4eb4-b2ba-61b19250ba2b None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:41.692960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 758/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 13:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:41.698140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193164-dc0f-4a46-992b-87fa54e61019 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:41.698540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193164-dc0f-4a46-992b-87fa54e61019 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:41.698690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193164-dc0f-4a46-992b-87fa54e61019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:41.718999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6a193164-dc0f-4a46-992b-87fa54e61019 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:41.720176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6a193164-dc0f-4a46-992b-87fa54e61019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:41.727878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 778/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:42.005950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6234-6e8b-41ec-a573-dc68fd2a141a None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:42.006266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6234-6e8b-41ec-a573-dc68fd2a141a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:42.006574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6234-6e8b-41ec-a573-dc68fd2a141a None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:42.007977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 759/1537] 10.222.0.26 () {54 vars in 963 bytes} [Thu May 5 13:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:52:42.012994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691a3-ef84-4f39-bfcf-694070b61e77 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:42.013284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691a3-ef84-4f39-bfcf-694070b61e77 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:42.013550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7691a3-ef84-4f39-bfcf-694070b61e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:42.031611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1d7691a3-ef84-4f39-bfcf-694070b61e77 None None] MFA Rules not processed for user `1b674fd55d7c4ea4bed85a42588278ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:52:42.032761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1d7691a3-ef84-4f39-bfcf-694070b61e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:52:42.039049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 779/1538] 10.222.0.26 () {58 vars in 1060 bytes} [Thu May 5 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:52:42.046770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b6234-6e8b-41ec-a573-dc68fd2a141a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:52:42.057087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b6234-6e8b-41ec-a573-dc68fd2a141a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:52:42.060536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:52:42.061144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:52:42.061420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:52:42.061695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:52:42.070262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:52:42.071673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310693-094b-42f2-be68-8829c10cc5a9 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:52:42.081106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 760/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:11.695968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:11.696670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:11.696670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:11.725819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:11.729705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:11.742160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 780/1540] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:11.752995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:11.754068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:11.754638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:11.779283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:11.780679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:11.792066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 761/1541] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:11.798034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:11.812378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7715851-de5a-49d7-82ac-c63713e6a43f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:11.823324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:11.823934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:11.824216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:11.824492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:11.825290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:11.825582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:11.827323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:11.852765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 781/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:11.862054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:11.876608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82fa77-a754-4d0e-ad06-f0b044e9baa9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:11.881635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:11.882355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:11.882637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:11.882914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:11.883611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:11.886232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0098b6a-a733-4813-8cca-df15e9552aeb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:11.993634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 762/1543] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:11 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:11.998501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.012913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f0983-6970-47af-ae07-bff688d9c31f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.032253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6335-b58a-4c58-9faa-7a8207e06c4c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.032591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6335-b58a-4c58-9faa-7a8207e06c4c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.033078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6335-b58a-4c58-9faa-7a8207e06c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.056039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-30ec6335-b58a-4c58-9faa-7a8207e06c4c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.057823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-30ec6335-b58a-4c58-9faa-7a8207e06c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.123363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.124048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.124331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.124605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.125315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.133554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717431b8-c89f-4b5c-a64d-403c773d3e7c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.155773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 763/1544] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.161550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688aa78-b804-4b82-8b29-34ce3e956513 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.161550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688aa78-b804-4b82-8b29-34ce3e956513 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.161550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688aa78-b804-4b82-8b29-34ce3e956513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.179531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f688aa78-b804-4b82-8b29-34ce3e956513 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.180759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f688aa78-b804-4b82-8b29-34ce3e956513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.191316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 764/1545] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.192732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf870e4-9c3a-4610-86e6-dbec32e39ffc None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.193020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf870e4-9c3a-4610-86e6-dbec32e39ffc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.193625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf870e4-9c3a-4610-86e6-dbec32e39ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.215283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 782/1546] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:11 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:12.216692 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9bdd-7e31-4a62-87de-85f9a9cba4c9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.217030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9bdd-7e31-4a62-87de-85f9a9cba4c9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.217387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9bdd-7e31-4a62-87de-85f9a9cba4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.224826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6cf870e4-9c3a-4610-86e6-dbec32e39ffc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.226331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6cf870e4-9c3a-4610-86e6-dbec32e39ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.236904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 765/1547] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.240460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6cab-6ef1-481a-8fb5-b6452373bfa5 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.240460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6cab-6ef1-481a-8fb5-b6452373bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.240460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6cab-6ef1-481a-8fb5-b6452373bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.240751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0d4c9bdd-7e31-4a62-87de-85f9a9cba4c9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.241587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0d4c9bdd-7e31-4a62-87de-85f9a9cba4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.252609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 783/1548] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.259733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.259733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.259733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.267845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0b3c6cab-6ef1-481a-8fb5-b6452373bfa5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.269409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0b3c6cab-6ef1-481a-8fb5-b6452373bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.280284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 766/1549] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.281103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.281685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976c6c-bc11-447f-9997-628ad408b2c6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.281973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976c6c-bc11-447f-9997-628ad408b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.282281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976c6c-bc11-447f-9997-628ad408b2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.282391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.290248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 784/1550] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.291188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.303445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649540f-9dcf-4a12-a0a9-33c04933c7ff None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.304752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fd976c6c-bc11-447f-9997-628ad408b2c6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.305950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fd976c6c-bc11-447f-9997-628ad408b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.309680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.310642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.311098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.311540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.312411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.314273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6a80-d44e-4f7d-a47a-a29038e6b916 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.320152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 767/1551] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.320152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bbd8f-61c7-482a-9151-6918912b759c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.320152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bbd8f-61c7-482a-9151-6918912b759c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.320152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bbd8f-61c7-482a-9151-6918912b759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.332907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 785/1552] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:12.334243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.334534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.334807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.340389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-da1bbd8f-61c7-482a-9151-6918912b759c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.341610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-da1bbd8f-61c7-482a-9151-6918912b759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.349615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 768/1553] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.351117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.351404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.351676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.354798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.355940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.364008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 786/1554] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.364693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.372168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.373374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.374576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1462ca-2fad-47ff-a500-15d6d1a0e46e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.379127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.379761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.380043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.380318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.381041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:12.381618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.381742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 769/1555] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.382250 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.383074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d14a21-10a8-4d17-b5de-dd8a059e2b39 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.391902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7b12a-afd6-410b-89f3-82ddacbabedd None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.395180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 787/1556] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:12.396767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.397423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.397704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.397977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.398822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:12.399128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.400137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:12.400137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:54:12.400137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:54:12.401126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281351d0-a6c6-4708-aa1b-45f40c146e03 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.403323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.403671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.403951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.420260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 770/1557] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:12.420260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.420260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.420260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.426176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.427369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.432355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.433512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.435304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 788/1558] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.436139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.444052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 771/1559] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.444853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.445583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546781be-578a-4b6e-b6ec-f5bafcddbeed None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.453771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.454453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.454718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ffba1-900b-4d30-96b4-433a1edb0a73 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.454839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.455001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.455727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.457576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.459438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.460076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.460354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.460622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.461341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:12.461644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.463311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10491812-4274-4a16-a37d-fd8ca26e1602 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.468702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 789/1560] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:12.469513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.475489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 772/1561] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:12.476643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.476932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.477208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.484419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2347-240d-4fa3-920f-9b00ed6e8729 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.489003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.489651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.489932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.490256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.490983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:12.491287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.492874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.495241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.496435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.504194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 773/1562] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.504618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 790/1563] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:12.505220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.505627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.515104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101116f-b3d0-454d-9b38-6266dcfbe111 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.515343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77ce5a-29e4-411f-8459-641814755a7b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.519563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.519793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.520198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.520415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.520531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.520694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.520793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.520966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.521413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.521640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.522677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:12.522677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:54:12.522677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:54:12.523370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fde24-2cd4-4757-b87d-6171b70129a3 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.523852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.660912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 791/1564] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:12.661811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.689919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 774/1565] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:12.691315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.693644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.693644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.710137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:12.714808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:12.723428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b3e3-2f45-4f62-ba56-c3f1ef73ec29 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.769000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 775/1566] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:12.769851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.779492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.780147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.780426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.780693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.781413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:12.781526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea44ca-a477-402a-a0fd-c351bbc16a6f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.781711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.783343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.786261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.787125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.787406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.787677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] PATH_INFO: `/v3/projects/b3c2d40011044e5d86c205f3cf09d56e/users/3337cd0a90cb4d72b093f6a912295125/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.802215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 792/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:12.803032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.806497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c2d40011044e5d86c205f3cf09d56e, user_id=3337cd0a90cb4d72b093f6a912295125, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.806497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.814850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbef99-a9b1-4e56-9ccf-2ce05c85fdf4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:12.821917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:12.822638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:12.822912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:12.823181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:12.823864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:12.825762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:12.893685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 776/1568] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:12 2022] PUT /identity/v3/projects/b3c2d40011044e5d86c205f3cf09d56e/users/3337cd0a90cb4d72b093f6a912295125/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:12.897480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.926688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 793/1569] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:12.926688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:12.955179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e259-2fd2-4ea1-b0e2-51e9f6a0ef1e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.015397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.016077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.016359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.016635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.017342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.019353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.112519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 777/1570] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:12 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.113368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.118408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21ad78-8c66-4fd6-bf09-51ac8545c2a4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.172061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c0e2-a46e-4147-9aab-5a1fdac54a1b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.175432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.176516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.176640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.177076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.177311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.177480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.177593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.177850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.178580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.178779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:13.179283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.179634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:13.179634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:54:13.179634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:54:13.180903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.182522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.195693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 794/1571] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:13.196603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.208661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159f92-17c6-4799-acee-3a00a15283ac admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.214165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.214821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.215092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.215389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.216572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.219818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.266226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 778/1572] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.266997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.276824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1ac2-c165-42e4-b6fc-84cb75739516 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.281321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.281966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.282258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.282533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.283245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:13.283547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.285157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b061452-931b-4a86-86bc-1f6912c6d593 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.289903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 795/1573] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.293530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.297859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 779/1574] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:13.299189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.299477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.299754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.300575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f07b-e855-4cf7-a451-d776a4762f45 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.305523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.306189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.306471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.306733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.307435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.309308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.317036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:13.319483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:13.326743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 780/1575] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:13.327628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.337266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fde7-bcf7-4512-95cd-ff721a1c940c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.342470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.343112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.343395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.343691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.344371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.346308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.409630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 796/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.410565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.443734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 781/1577] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.443734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.451819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776ea6-a45c-4e28-8a7e-3404d5d2b0c7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.472297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df77fc-de64-4abf-8f39-cc09ea99bfd0 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.476761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.477424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.477702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.477969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.478680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.480601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.508902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.509558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.509834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.510581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.511225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.513909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.609672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 797/1578] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.610550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.619956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec617a-924b-44d7-bcb9-b2aed570b84f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.624606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.625493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.625771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.626059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.626887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.628476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.643989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 798/1579] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.643989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.646434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 782/1580] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.648737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.656301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fafcd-d2b0-4c6e-a0de-0d3982b9c6e7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.708423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d1028-2137-4003-9f14-1d315592fb1d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.711995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.712683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.712959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.713569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.713739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.714236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.714519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.714627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.714796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.715482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.716214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.717375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.725857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 799/1581] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.726768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.774986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 783/1582] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.776105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.782126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716465-d190-4cf6-997b-01ed1419fecc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.829573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.830256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.830537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.830814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.838908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7eb41-4e7c-43de-969e-354752afabea admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.840928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.842337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.843824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.844487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.844769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.845050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.845744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.847756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.852389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 800/1583] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:13.859242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.869084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf447c-45db-4f45-8e96-cf663edcbdca service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.874325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.875020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.875362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.875632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.876358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.878145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.888014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 801/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.888800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.898067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4ead-aa18-4288-9e6e-be134891b483 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.902580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.903184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.903596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.903874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.904567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.906133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.915743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 802/1585] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.917044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.926380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20007f0-8a16-4ed1-bb4a-c4d8f9456448 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.931284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.931940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.932739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.933015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.933709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.935365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.945513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 803/1586] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.946298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.949559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 784/1587] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:13.950481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.957765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456305c-8964-4545-bbd3-2ba5ba63cf47 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.960539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac556-8d2e-4cf3-bea2-1268226c5871 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.962304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.962954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.963228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.963492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.964164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.965479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.966048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.966197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.966463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.966742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.967514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.969158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:13.979690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 785/1588] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:13.980988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:13.990169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3011-fc33-4c71-9ae0-9fb1be840b3e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:13.995333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:13.995976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:13.996255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:13.996531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:13.997239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:13.999191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.105925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 804/1589] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:14.106982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.116292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc793b-cb31-4be4-bc9b-a0156e797873 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.121389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.122053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.122318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.122590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.123304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.124882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.134473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 805/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.135636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.145478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e211640-c32a-4c46-a057-db046f4315e1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.146348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 786/1591] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:13 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:14.151723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.151840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.151840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.151840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.151840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.152387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.154221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.156944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d174b93-bbb1-4e5a-9d89-2d08ef2867d6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.161608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.162501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.162783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.163088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] PATH_INFO: `/v3/projects/f9a996d379a449c1b9375fbfa747c750/users/1e5b0babb4c944819a6bbe12fdd1a9ed/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.168337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 806/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.168337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.176237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935dc69-0ca7-4797-807c-e98a57b4cd54 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.179165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a996d379a449c1b9375fbfa747c750, user_id=1e5b0babb4c944819a6bbe12fdd1a9ed, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.186458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.186458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.186458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.186796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.186883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.186883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.186883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.195117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 807/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.195879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.205001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5d0b5-318e-4e95-bbee-9aa7f044f6fd admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.211112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.211112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.211435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.211435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] PATH_INFO: `/v3/projects/fa0109207d3746c1a56d819f684f0b83/users/449418bf2a1d47d982b4beb8d58dfbb0/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.230413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0109207d3746c1a56d819f684f0b83, user_id=449418bf2a1d47d982b4beb8d58dfbb0, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.231691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:14.231691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:54:14.231691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:54:14.233756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.269494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 787/1594] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/f9a996d379a449c1b9375fbfa747c750/users/1e5b0babb4c944819a6bbe12fdd1a9ed/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:14.269494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.329248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 808/1595] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/fa0109207d3746c1a56d819f684f0b83/users/449418bf2a1d47d982b4beb8d58dfbb0/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:14.335750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.335860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d97f7-e897-4175-be02-d9b33bcda413 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.392474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.393152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.393428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.393700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.394465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.396062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.396969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57443c87-d0a7-4018-9f8f-9ffd18e7e85c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.402247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.403198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.403478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.403771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] PATH_INFO: `/v3/projects/629e79f6467c4c69b2c4753caeebf9b3/users/02c53eb1b2664afbb62f0a92da47c7f3/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.406574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 788/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.407423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.418102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045878d-c0cf-4638-9c01-9f140bdb9563 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.422591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.423239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.423610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.423841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.424785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.426179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.429576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629e79f6467c4c69b2c4753caeebf9b3, user_id=02c53eb1b2664afbb62f0a92da47c7f3, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.432875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.436920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 789/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.437713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.449894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba995e-5a17-4aec-9e14-b47d6cfbd257 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.454526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.455390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.455669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.455935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] PATH_INFO: `/v3/projects/aeca86029be24b37b422da55bb50fe86/users/7c8ec5eae2664ca8977fd7163dca8286/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.477312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeca86029be24b37b422da55bb50fe86, user_id=7c8ec5eae2664ca8977fd7163dca8286, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.477312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cc176-7d82-44a4-9d49-1f2b42018e2c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.522696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 809/1598] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/629e79f6467c4c69b2c4753caeebf9b3/users/02c53eb1b2664afbb62f0a92da47c7f3/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:14.523538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.588684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc9c9-eb63-4edd-ba1b-f6286e257160 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.589726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 790/1599] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/aeca86029be24b37b422da55bb50fe86/users/7c8ec5eae2664ca8977fd7163dca8286/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:14.591124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.591465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.591756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.619812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] MFA Rules not processed for user `1e5b0babb4c944819a6bbe12fdd1a9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:14.621120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:14.652945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.653214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.653407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.653681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.654539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.656137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a2e0e-c8cf-4a0a-9b23-8a99043d160c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.670784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 810/1600] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.672413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb42c6-ef07-4c77-b759-152d2cd2006c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.672708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb42c6-ef07-4c77-b759-152d2cd2006c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.672987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb42c6-ef07-4c77-b759-152d2cd2006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.692166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 791/1601] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:14.693688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.705744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e5eb42c6-ef07-4c77-b759-152d2cd2006c None None] MFA Rules not processed for user `449418bf2a1d47d982b4beb8d58dfbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:14.707428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e5eb42c6-ef07-4c77-b759-152d2cd2006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:14.708646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3427-79f8-4caa-9995-643c0ba7d522 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.713573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.714493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.714845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.715182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.716446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.717821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.735672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 792/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.735672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.741985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814520c-9172-48bb-a36e-4db613111787 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.748035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.748805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.749159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.749503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.750355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.752117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1911c7-c3c5-4aa0-a7a9-8fa4e617cc14 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.763520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 793/1603] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:14.766712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.766712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.766712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.778887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 811/1604] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:14.780220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb251-02a8-4046-9f9c-07040fda1304 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.780509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb251-02a8-4046-9f9c-07040fda1304 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.780783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb251-02a8-4046-9f9c-07040fda1304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.794890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] MFA Rules not processed for user `02c53eb1b2664afbb62f0a92da47c7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:14.796280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:14.812403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4d3fb251-02a8-4046-9f9c-07040fda1304 None None] MFA Rules not processed for user `7c8ec5eae2664ca8977fd7163dca8286`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:14.813600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4d3fb251-02a8-4046-9f9c-07040fda1304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:14.867246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 794/1605] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:14.868094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.882530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f51d-0eb2-468f-a777-b2c1df5979eb None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.888699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.890237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.890523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.890791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] PATH_INFO: `/v3/projects/8536ba08456944f5a554574f98c72fb2/users/add9c19abc0a46feb0be090a9a6641c1/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.891667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 812/1606] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:14.892989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534142-0596-4d43-8056-e9cc42b4997a None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.893272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534142-0596-4d43-8056-e9cc42b4997a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.893543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534142-0596-4d43-8056-e9cc42b4997a None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.894967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 813/1607] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:14.899079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534142-0596-4d43-8056-e9cc42b4997a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:14.907479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8536ba08456944f5a554574f98c72fb2, user_id=add9c19abc0a46feb0be090a9a6641c1, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.910449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:14.911395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534142-0596-4d43-8056-e9cc42b4997a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:14.915874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:14.917250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:14.917528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:14.917913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] PATH_INFO: `/v3/projects/eb57f4c97b6a4f46ad3f1c129569ba8f/users/4fc6b5e9c3ef4b6799795116f8e81b51/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:14.933307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb57f4c97b6a4f46ad3f1c129569ba8f, user_id=4fc6b5e9c3ef4b6799795116f8e81b51, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:14.935999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9d9c9-a638-4e47-a3ae-5e70c2e54c33 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.025579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 795/1608] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/8536ba08456944f5a554574f98c72fb2/users/add9c19abc0a46feb0be090a9a6641c1/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:15.027097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.037103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 814/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:14 2022] PUT /identity/v3/projects/eb57f4c97b6a4f46ad3f1c129569ba8f/users/4fc6b5e9c3ef4b6799795116f8e81b51/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:15.038451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ccbe5-0bc1-4b21-9c20-dc2e37a2633f None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.038733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ccbe5-0bc1-4b21-9c20-dc2e37a2633f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.038996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ccbe5-0bc1-4b21-9c20-dc2e37a2633f None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.040419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 815/1610] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:15.041911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ccbe5-0bc1-4b21-9c20-dc2e37a2633f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.089827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fdda0-d0ee-43cc-a786-afb61e143f10 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.106987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ccbe5-0bc1-4b21-9c20-dc2e37a2633f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.111590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.112497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.112780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.113057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.113753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.115701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef830b2a-8e71-4bbb-b682-3fad6927cb2f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.147230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.148136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.148418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.148692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] PATH_INFO: `/v3/projects/82ab8738882a4a46b297f2221637275a/users/b5e7cb9b782548fe97b942caeca1b6e9/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.164571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ab8738882a4a46b297f2221637275a, user_id=b5e7cb9b782548fe97b942caeca1b6e9, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.169813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc374a8-68cd-408e-baa6-eef1011740b0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.254981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 816/1611] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:15.255724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564efb-7b3c-4da6-bcb4-b2fbe0c09c71 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.256015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564efb-7b3c-4da6-bcb4-b2fbe0c09c71 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.256284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b564efb-7b3c-4da6-bcb4-b2fbe0c09c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.275436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2b564efb-7b3c-4da6-bcb4-b2fbe0c09c71 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:15.276690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2b564efb-7b3c-4da6-bcb4-b2fbe0c09c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:15.343105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 817/1612] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:15.344560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325097-e9b1-420c-9fdc-c104ce0ddb72 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.344844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325097-e9b1-420c-9fdc-c104ce0ddb72 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.345115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325097-e9b1-420c-9fdc-c104ce0ddb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.362585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 796/1613] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:15 2022] PUT /identity/v3/projects/82ab8738882a4a46b297f2221637275a/users/b5e7cb9b782548fe97b942caeca1b6e9/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:15.362812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d6325097-e9b1-420c-9fdc-c104ce0ddb72 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:15.363925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d6325097-e9b1-420c-9fdc-c104ce0ddb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:15.364901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.365518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.366186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.384803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:15.386274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:15.441601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 818/1614] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:15.442839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.443120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.443391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.465532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:15.466777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:15.474250 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 797/1615] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:15.481467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.492002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f071-7dd6-457d-9123-b02c806afd1c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.497524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.498425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.498715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.498989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.499755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.501744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cac9c-6c3b-4f48-bab5-bedfe48cea5c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.565190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 819/1616] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:15.565799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.577339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c36d9-b902-4945-900e-7ac7338aa035 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.579487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 798/1617] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:15.583265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.584059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.584406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.587138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.587804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.588117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.588493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.631842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] MFA Rules not processed for user `b5e7cb9b782548fe97b942caeca1b6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:15.633318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:15.655391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.657198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.667580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 820/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:15.668430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.707046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 799/1619] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:15.708561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.744755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9cb-7aad-4d33-9be0-2f6cdf0ca431 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.749775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.750996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.751276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.751545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.764310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.766068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.779215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 821/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:15.779848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5c79-2883-4fd8-ab9c-76f8eb43caf6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.780089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.786771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.787434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.787884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.788272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.794893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7566e-d350-4720-ac99-2b2200ffc562 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.803300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.805040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.809234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.811553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.811836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.812124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.817498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 800/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:15.818548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.831795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6435a-64ff-4b71-ab87-80260e3131d2 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.839073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.839759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.840039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.840544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.841680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.844032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.862459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 801/1622] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:15.862459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.880089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28a29-ac77-4010-a8ec-282db4a5823d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.885453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.886200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.886490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.886769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.887813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.890297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef83be-b402-483d-814f-c74ada1d1893 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.942636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:15.944455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:15.955038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 822/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:15.955877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:15.966858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f107-9fd2-4fb1-9209-3e2309dedf79 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:15.971882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:15.972775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.973086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.973319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] PATH_INFO: `/v3/projects/fac2fb66c03844ffaf01193c089da41a/users/204409e6350844f5a57cafa1f0136f16/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.984412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 802/1624] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:15.986690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35f00-6716-449e-a06d-c71c18c47e4f None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:15.986690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35f00-6716-449e-a06d-c71c18c47e4f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:15.986863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef35f00-6716-449e-a06d-c71c18c47e4f None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:15.988610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 803/1625] 10.222.0.26 () {54 vars in 912 bytes} [Thu May 5 13:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:15.989433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef35f00-6716-449e-a06d-c71c18c47e4f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.001005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac2fb66c03844ffaf01193c089da41a, user_id=204409e6350844f5a57cafa1f0136f16, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.007991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4a00-7607-4637-aea9-37a832820e07 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.066724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef35f00-6716-449e-a06d-c71c18c47e4f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.073151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.073912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.074323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.074672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.075701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.078406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.110041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 823/1626] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:15 2022] PUT /identity/v3/projects/fac2fb66c03844ffaf01193c089da41a/users/204409e6350844f5a57cafa1f0136f16/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:16.110041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.110041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.110041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.127467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:16.128655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:16.193877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 824/1627] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:16.194825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.262187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4a12-62be-4109-9188-8b9efdb9a571 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.269671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.269871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.270082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.270302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.271047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.272879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be693b-296b-425a-a2d9-0b26c3207f41 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.286894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 825/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:16.286894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15e32-d201-4dd3-9452-24ea9ae15c54 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.286894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15e32-d201-4dd3-9452-24ea9ae15c54 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.289030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 804/1629] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:15 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:16.289133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15e32-d201-4dd3-9452-24ea9ae15c54 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.289457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.290174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 826/1630] 10.222.0.26 () {54 vars in 912 bytes} [Thu May 5 13:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:16.290994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15e32-d201-4dd3-9452-24ea9ae15c54 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.308545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15e32-d201-4dd3-9452-24ea9ae15c54 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.314721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.315622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.315903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.316178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] PATH_INFO: `/v3/projects/fac2fb66c03844ffaf01193c089da41a/users/204409e6350844f5a57cafa1f0136f16/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.318311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac2fb66c03844ffaf01193c089da41a, user_id=204409e6350844f5a57cafa1f0136f16, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.321018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.350849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 827/1631] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:16 2022] PUT /identity/v3/projects/fac2fb66c03844ffaf01193c089da41a/users/204409e6350844f5a57cafa1f0136f16/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:16.350849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.379575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c257-b9ff-46e9-b259-feb29b92a656 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.440285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.440562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.440665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.440904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.449492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b42129-e73b-4f4c-bd46-8c4be6bc04b0 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.449492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.449817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.450338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.450780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.451724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.453489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813046d2-1e20-4303-b20b-15af7e8482ef admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.467959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 828/1632] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:16.467959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.467959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.467959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.487866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:16.543134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:16.559214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.560665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a5f0-afb5-45c3-9acf-e2db11290014 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.578937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 805/1633] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:16.585003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.585003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.585003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.617401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] MFA Rules not processed for user `204409e6350844f5a57cafa1f0136f16`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:16.618739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:16.655925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 829/1634] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:16.657940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.677620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f8c1-acbd-4399-a8d5-c0c6c1fd2257 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.684503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.685926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.686434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.688798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] PATH_INFO: `/v3/projects/fd95cbb3516345afb86a11927af4bebe/users/757255f767534207adcd52d56ed3fab6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.711615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd95cbb3516345afb86a11927af4bebe, user_id=757255f767534207adcd52d56ed3fab6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.715646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.737742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 806/1635] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:16.738811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.753322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f9441-0c51-4a16-9efb-0877ae6e63af None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.758516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.759237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.759523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.759850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.771571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.772944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.785046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 807/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:16.847796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 830/1637] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:16 2022] PUT /identity/v3/projects/fd95cbb3516345afb86a11927af4bebe/users/757255f767534207adcd52d56ed3fab6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:16.851901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.864109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f954d2-35e9-4fed-a84e-84bb90713f45 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:16.954204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:16.955082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:16.955563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:16.956999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:16.958107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:16.959859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d90b9-5de4-4894-b985-7a7b259dd3d0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:16.978364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 808/1638] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:16.979643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:16.995284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c25b6-89bd-40fd-bd23-965237e2f7cf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:17.004352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:17.005578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:17.005858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:17.006944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] PATH_INFO: `/v3/projects/fd95cbb3516345afb86a11927af4bebe/users/757255f767534207adcd52d56ed3fab6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:17.010689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd95cbb3516345afb86a11927af4bebe, user_id=757255f767534207adcd52d56ed3fab6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:17.014106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:17.045557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 831/1639] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:16 2022] PUT /identity/v3/projects/fd95cbb3516345afb86a11927af4bebe/users/757255f767534207adcd52d56ed3fab6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:17.048341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:17.051293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:17.051293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:17.083487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] MFA Rules not processed for user `757255f767534207adcd52d56ed3fab6`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:17.084950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:17.170204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 809/1640] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:17.947210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:18.054344 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:18.062514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22b3-dda5-4bc3-ae43-a5c8cad74f52 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:18.070259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94832-c616-4ac7-bb6f-7e82405feba8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:18.076848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:18.079547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:18.080361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:18.080997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:18.081792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:18.083412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:18.084108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:18.084742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:18.119249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:18.119249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:18.142096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 810/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:18.198417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:18.200039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:18.225480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 832/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:18.377396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:18.607990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:18.616212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f224aec-da57-4951-a5f8-3f581cc76e8f service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:18.618378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f932-5b2d-40b8-96e2-f8941a5d5dd1 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:18.635395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:18.636214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:18.641893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:18.641893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:18.643344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:18.644135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:18.646426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:18.648713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:18.745276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:18.748040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:18.767109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 811/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:18.772981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:18.774873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f3d27-216a-4e1c-a949-e4a6928caba7 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:18.808149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 833/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:19.235663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:19.333521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510898-7928-4c9f-9c12-7223ee3bb2b4 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:19.347216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:19.347216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:19.347216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:19.347216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] PATH_INFO: `/v3/users/7c8ec5eae2664ca8977fd7163dca8286` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:19.348327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8ec5eae2664ca8977fd7163dca8286)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:19.351525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:19.384108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfd94-b703-4028-99d3-82a7f1eec534 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:19.384609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfd94-b703-4028-99d3-82a7f1eec534 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:19.385283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfd94-b703-4028-99d3-82a7f1eec534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:19.457329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-bc2dfd94-b703-4028-99d3-82a7f1eec534 None None] MFA Rules not processed for user `4fc6b5e9c3ef4b6799795116f8e81b51`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:19.459520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bc2dfd94-b703-4028-99d3-82a7f1eec534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:19.582658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 834/1645] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:19.602671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:19.603000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:19.603280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:19.621302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8ec5eae2664ca8977fd7163dca8286'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:19.656582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8ec5eae2664ca8977fd7163dca8286'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:19.659687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8ec5eae2664ca8977fd7163dca8286'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:19.660542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8ec5eae2664ca8977fd7163dca8286'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:19.664286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] MFA Rules not processed for user `4fc6b5e9c3ef4b6799795116f8e81b51`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:19.665924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:19.681933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 835/1646] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:19.697836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:19.699659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:19.766113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfadcdc-83fb-44d0-8009-9a49ca029055 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:19.786265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:19.787425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:19.789716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-66415f7b-f729-4d78-8b0b-1d053d52232e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8ec5eae2664ca8977fd7163dca8286'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:19.792657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:19.796483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:19.801185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:19.825819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 812/1647] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:19 2022] DELETE /identity/v3/users/7c8ec5eae2664ca8977fd7163dca8286 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:19.827664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:19.828214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:19.828689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:19.833705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:19.839913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:19.877143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 836/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:19.888166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:19.895700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:20.043214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:20.044363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:20.058535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 813/1649] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:20.071085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8915f-4ec4-42be-8a29-487c2afae482 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:20.076973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:20.085448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:20.086998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:20.089820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:20.092497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:20.092647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] PATH_INFO: `/v3/users/02c53eb1b2664afbb62f0a92da47c7f3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:20.095057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c53eb1b2664afbb62f0a92da47c7f3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:20.095767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: WARNING py.warnings [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:20.095767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: warnings.warn(msg) May 05 13:54:20.095767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: May 05 13:54:20.098515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:20.189202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071bbd-a035-4f1d-b2f3-199bbf7677e3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:20.202837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:20.205105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:20.205398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:20.438383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:20.438383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:20.438383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778a255-83d4-422c-99fe-9ffe1f362df1 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:20.438383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 814/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:20.440974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c53eb1b2664afbb62f0a92da47c7f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:20.493645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c53eb1b2664afbb62f0a92da47c7f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:20.498264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c53eb1b2664afbb62f0a92da47c7f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:20.672567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c53eb1b2664afbb62f0a92da47c7f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:20.679402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8f3c2a0f-bf41-4d32-abd6-41ae0325b18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c53eb1b2664afbb62f0a92da47c7f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:20.696417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28fe4-16c3-4e86-98ce-47f2bdc53266 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:20.696888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28fe4-16c3-4e86-98ce-47f2bdc53266 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:20.697936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28fe4-16c3-4e86-98ce-47f2bdc53266 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:20.700484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 815/1651] 10.222.0.26 () {54 vars in 912 bytes} [Thu May 5 13:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:54:20.728219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:20.728543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:20.728926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:20.774740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 837/1652] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:20 2022] DELETE /identity/v3/users/02c53eb1b2664afbb62f0a92da47c7f3 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:20.776286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:20.776573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:20.776855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:20.789849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:20.793584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:20.817302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:20.819538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:20.966256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 816/1653] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:21.006457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 838/1654] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:21.019332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:21.023019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:21.045501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9e210-2888-43bd-99d5-2cb5d448a640 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:21.049744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:21.051977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:21.071733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:21.073542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:21.075590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:21.076371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:21.090398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269572c9-66ae-48cf-b917-5131de85eb3d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:21.115385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:21.117373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:21.117659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:21.118066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:21.123449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:21.125236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:21.145173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 817/1655] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:21.154833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:21.156753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b53da-281d-4e4d-83d5-e68922c78647 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:21.168395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 839/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:21.800216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:21.801891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:21.846779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818723-3784-49a3-9490-c2a23622aa7d service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:21.870202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:21.871181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:21.872777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:21.873068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] PATH_INFO: `/v3/projects/aeca86029be24b37b422da55bb50fe86` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:21.877131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeca86029be24b37b422da55bb50fe86)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:21.878296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: WARNING py.warnings [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 13:54:21.878296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: warnings.warn(msg) May 05 13:54:21.878296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: May 05 13:54:21.882274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:22.121133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeca86029be24b37b422da55bb50fe86', 'request_id': 'req-6479ad4d-3d36-4775-b61c-a6b822e01480'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:22.152833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeca86029be24b37b422da55bb50fe86', 'request_id': 'req-6479ad4d-3d36-4775-b61c-a6b822e01480'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:22.269615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeca86029be24b37b422da55bb50fe86', 'request_id': 'req-6479ad4d-3d36-4775-b61c-a6b822e01480'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:22.304530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] The token cache is being invalidate because project aeca86029be24b37b422da55bb50fe86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:22.306273 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:22.308749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6479ad4d-3d36-4775-b61c-a6b822e01480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:22.316329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 818/1657] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:21 2022] DELETE /identity/v3/projects/aeca86029be24b37b422da55bb50fe86 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:22.325537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a8a59-eeeb-46c7-8921-3f40e80be1de None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.326861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a8a59-eeeb-46c7-8921-3f40e80be1de None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.327362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a8a59-eeeb-46c7-8921-3f40e80be1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.412466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-490a8a59-eeeb-46c7-8921-3f40e80be1de None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:22.413702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-490a8a59-eeeb-46c7-8921-3f40e80be1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:22.423975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc0440-535b-44a7-9dda-62047b407eb0 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.424282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc0440-535b-44a7-9dda-62047b407eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.424575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc0440-535b-44a7-9dda-62047b407eb0 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.426429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 819/1658] 10.222.0.26 () {54 vars in 960 bytes} [Thu May 5 13:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:22.433784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.434114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.434388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.491084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:22.492321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:22.598283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 840/1659] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:22.605895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.606881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.608262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.660687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:22.663415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:22.679396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 841/1660] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:22.682972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 820/1661] 10.222.0.26 () {58 vars in 1057 bytes} [Thu May 5 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 05 13:54:22.689440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:22.689590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:22.705859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160f076-f117-47d1-ac54-5bb62d6ffb49 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:22.708869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6f902-aa81-456b-8135-bebff21efaf6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:22.711892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:22.712798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.713239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.713578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.714848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:22.715704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:22.717829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:22.741330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:22.741330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.741760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 842/1662] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:22.741832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.741832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.746938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:22.747374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:22.760470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97d28-13ed-4b55-88d6-f70eec87d777 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:22.767582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:22.768685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:22.768974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:22.769248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:22.769954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:22.773895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:22.774505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:22.776240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:22.803058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 821/1663] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:22.952922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 843/1664] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:22 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:22.957188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:22.973896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c5e2-542c-44b8-ba67-eba76d4e4816 service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.067416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:23.069833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:23.112976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.113753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.114719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.114719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.115315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.121254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.247118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108188-498f-4f57-98b0-69fda94519d9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.247118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.247118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.247118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.247854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] PATH_INFO: `/v3/projects/629e79f6467c4c69b2c4753caeebf9b3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.247854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=629e79f6467c4c69b2c4753caeebf9b3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.247854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.391876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 822/1665] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:22 2022] POST /identity/v3/users => generated 287 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:23.395984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:23.415176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ed3ca-33c5-442f-9efe-940f9cff6648 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.430898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.432477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.432685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.432953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.433693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.435401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.449278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629e79f6467c4c69b2c4753caeebf9b3', 'request_id': 'req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:23.457311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 823/1666] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:23.459578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629e79f6467c4c69b2c4753caeebf9b3', 'request_id': 'req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:23.461126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:23.474102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60dab-71dd-4194-8128-cb0295987116 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.586695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.587385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.587727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.588035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.588778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.590531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.596453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629e79f6467c4c69b2c4753caeebf9b3', 'request_id': 'req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:23.607965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 824/1667] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:23.608946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:23.618107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] The token cache is being invalidate because project 629e79f6467c4c69b2c4753caeebf9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:23.618664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:23.619593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:23.619907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5b925-14ad-4bbb-acf6-8d167624b65f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.622478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 844/1668] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:23 2022] DELETE /identity/v3/projects/629e79f6467c4c69b2c4753caeebf9b3 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:23.628790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.629382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:23.629855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.630104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.630422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] PATH_INFO: `/v3/projects/4995eda5c2a3489bb4331d36590afbee/users/01ed031ea91d498082f54afe60f02cf9/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.631023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:23.665212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4995eda5c2a3489bb4331d36590afbee, user_id=01ed031ea91d498082f54afe60f02cf9, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.668200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda14b6-e4ec-4d95-b70e-d8bf4d124442 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.715944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3abc-e1cd-463e-b4b4-5dab7dda8f3a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:23.732848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:23.735178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.735178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.735178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] PATH_INFO: `/v3/users/204409e6350844f5a57cafa1f0136f16` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.738880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204409e6350844f5a57cafa1f0136f16)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:23.742973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:23.764393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 825/1669] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:23 2022] PUT /identity/v3/projects/4995eda5c2a3489bb4331d36590afbee/users/01ed031ea91d498082f54afe60f02cf9/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:23.779509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2841f5-ba60-411b-adaf-febc291c8e69 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.779971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2841f5-ba60-411b-adaf-febc291c8e69 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.780357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2841f5-ba60-411b-adaf-febc291c8e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:23.851889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3e2841f5-ba60-411b-adaf-febc291c8e69 None None] MFA Rules not processed for user `01ed031ea91d498082f54afe60f02cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:23.858668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3e2841f5-ba60-411b-adaf-febc291c8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:23.958877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 826/1670] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:23.962059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:23.962202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:23.962568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.003443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] MFA Rules not processed for user `3337cd0a90cb4d72b093f6a912295125`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:24.004648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:24.044036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204409e6350844f5a57cafa1f0136f16'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:24.053452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204409e6350844f5a57cafa1f0136f16'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:24.054528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204409e6350844f5a57cafa1f0136f16'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:24.109068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 827/1671] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:24.109068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.109068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:24.179591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55e5c-fbd1-446b-bdbf-bf7f375f23e6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.185376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.186069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.186353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.186625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.187971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.189923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.237167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204409e6350844f5a57cafa1f0136f16'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:24.237851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204409e6350844f5a57cafa1f0136f16'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:24.258942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 845/1672] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:23 2022] DELETE /identity/v3/users/204409e6350844f5a57cafa1f0136f16 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:24.260792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.262575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:24.374315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 828/1673] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:24 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:24.375617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.413996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5aba6-626f-4b44-9853-85b7bcdf63d8 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.526785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f1247-c693-4467-ac45-eb19b98f2bfb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.532924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.534103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.534501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.534882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.535794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.535968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.536637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.536915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.537189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.538577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.674740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 829/1674] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:24 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:24.679243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.683077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.684703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.702998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd620-f830-4fc4-a2bf-e2b628735ab9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.708062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 846/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:24.716929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.717686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.720073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.720766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.721287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.723326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.735882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 830/1676] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:24.741363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.771808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:24.774317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b604427-e945-45ac-bbad-d84a34cf1d60 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.779877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:24.791526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.792643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.793230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.796237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] PATH_INFO: `/v3/projects/838144148e7b4b4698a974c08dd35ca1/users/545624806f4841bbbe5aa7365c1e9152/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.824436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=838144148e7b4b4698a974c08dd35ca1, user_id=545624806f4841bbbe5aa7365c1e9152, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.827687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.830106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292d54-48ab-441d-8de5-66dc6fafe7d9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:24.846888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:24.847804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:24.848090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:24.848370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] PATH_INFO: `/v3/users/b5e7cb9b782548fe97b942caeca1b6e9` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:24.852327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e7cb9b782548fe97b942caeca1b6e9)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:24.856734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:24.955404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 847/1677] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:24 2022] PUT /identity/v3/projects/838144148e7b4b4698a974c08dd35ca1/users/545624806f4841bbbe5aa7365c1e9152/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:24.959700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:25.147333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e69cb-a043-4c73-9891-7d2d425697fc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:25.160230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:25.160932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.161213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.161489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.162259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:25.167378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:25.188407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 848/1678] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:25.191388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:25.208238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:25.216071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e7cb9b782548fe97b942caeca1b6e9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.241544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e7cb9b782548fe97b942caeca1b6e9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.244004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e7cb9b782548fe97b942caeca1b6e9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.248268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e7cb9b782548fe97b942caeca1b6e9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.259371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f9e5-1d70-4fc6-aa03-95648e04049f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:25.285500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:25.286476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.287233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.287233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] PATH_INFO: `/v3/projects/fac2fb66c03844ffaf01193c089da41a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.296255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac2fb66c03844ffaf01193c089da41a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:25.301857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:25.334503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e7cb9b782548fe97b942caeca1b6e9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.384442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 831/1679] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:24 2022] DELETE /identity/v3/users/b5e7cb9b782548fe97b942caeca1b6e9 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:25.384442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:25.391519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:25.544720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac2fb66c03844ffaf01193c089da41a', 'request_id': 'req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.566484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac2fb66c03844ffaf01193c089da41a', 'request_id': 'req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.574390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6961f-49c2-486f-b016-35dcf1e55083 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:25.663018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:25.664169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.664287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.664479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] PATH_INFO: `/v3/projects/838144148e7b4b4698a974c08dd35ca1/users/545624806f4841bbbe5aa7365c1e9152/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.666591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838144148e7b4b4698a974c08dd35ca1, user_id=545624806f4841bbbe5aa7365c1e9152, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:25.675459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161b60c-cd5b-432d-86ec-8ce1dd687ec2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:25.681048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac2fb66c03844ffaf01193c089da41a', 'request_id': 'req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.711800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] The token cache is being invalidate because project fac2fb66c03844ffaf01193c089da41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:25.714157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.715865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:25.717654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 849/1680] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:25 2022] DELETE /identity/v3/projects/fac2fb66c03844ffaf01193c089da41a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:25.722071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:25.734509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 832/1681] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:25 2022] PUT /identity/v3/projects/838144148e7b4b4698a974c08dd35ca1/users/545624806f4841bbbe5aa7365c1e9152/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:25.734509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee865-cd90-430d-ba9a-053973591b2c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.734509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee865-cd90-430d-ba9a-053973591b2c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.734509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee865-cd90-430d-ba9a-053973591b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.735055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:25.755990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81b84c-c2d2-4a2b-9421-7632b0ec740a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:25.767567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fecee865-cd90-430d-ba9a-053973591b2c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:25.770578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fecee865-cd90-430d-ba9a-053973591b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:25.866994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:25.867921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.868195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.868469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] PATH_INFO: `/v3/users/449418bf2a1d47d982b4beb8d58dfbb0` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.869718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=449418bf2a1d47d982b4beb8d58dfbb0)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:25.871679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:25.893078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 833/1682] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:25.894525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88188a2-56db-49f5-ae09-966c6a712a9c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:25.894946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88188a2-56db-49f5-ae09-966c6a712a9c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:25.895276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88188a2-56db-49f5-ae09-966c6a712a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:25.948666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f88188a2-56db-49f5-ae09-966c6a712a9c None None] MFA Rules not processed for user `add9c19abc0a46feb0be090a9a6641c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:25.950158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f88188a2-56db-49f5-ae09-966c6a712a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.050146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 834/1683] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:26.051682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034f55-8e50-41e6-8295-6ff487a34b3c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.052119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034f55-8e50-41e6-8295-6ff487a34b3c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.052396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034f55-8e50-41e6-8295-6ff487a34b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.074430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-86034f55-8e50-41e6-8295-6ff487a34b3c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:26.075747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-86034f55-8e50-41e6-8295-6ff487a34b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.084279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 835/1684] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:26.085536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.085830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.086140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.117735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] MFA Rules not processed for user `545624806f4841bbbe5aa7365c1e9152`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:26.118958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.165758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449418bf2a1d47d982b4beb8d58dfbb0'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:26.177191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449418bf2a1d47d982b4beb8d58dfbb0'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:26.178165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449418bf2a1d47d982b4beb8d58dfbb0'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:26.210160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 836/1685] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:26.211070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:26.212496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.292015 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c7a0f-7f95-4b24-92de-3aa3fb405272 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:26.296498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:26.299114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.299509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.299888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.304570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449418bf2a1d47d982b4beb8d58dfbb0'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:26.305415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449418bf2a1d47d982b4beb8d58dfbb0'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:26.308754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.335891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 850/1686] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:25 2022] DELETE /identity/v3/users/449418bf2a1d47d982b4beb8d58dfbb0 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:26.336994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:26.338677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.360562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:26.362384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcfbb-af38-48d4-8933-814d820de361 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:26.394511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 837/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:26.396039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.396330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.396609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.450482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:26.451740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.547394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62194d-8ece-428b-bf79-f57b34224eec admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:26.569363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:26.581890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.582603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.582981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.585105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.602414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 838/1688] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:26.603697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:26.607181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.666440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:26.668378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635597d4-ed0a-4305-83c6-2723d94a4273 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:26.680535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 851/1689] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:26.682214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.682546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.682830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.687325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5d305-89ee-4c97-93de-ae3994cd66bd None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:26.692289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:26.693003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.693277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.693546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.705500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:26.707664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.729351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 852/1690] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:26.729351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:26.743213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2be8a-8774-4961-b967-f026f5a26287 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:26.761370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:26.762122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:26.762456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:26.771986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:26.771986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:26.771986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:26.771986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:26.797369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 853/1691] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:26.798458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:26.800471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:26.965769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:26.983593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.026185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 839/1692] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:27.027323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:27.028197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76390-122c-4c53-915c-d06c444c5244 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.042650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.043384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.046345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.046639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.055732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b76-8351-488b-ba35-64784b00991e service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.070052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.071188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.073549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.073845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.074653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:27.079766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:27.083565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.086424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.147542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 854/1693] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:27.156718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:27.168583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:27.213773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf358-0cbc-4826-8861-47e933fd960f service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.229969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.231149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.231431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.231703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] PATH_INFO: `/v3/users/1e5b0babb4c944819a6bbe12fdd1a9ed` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.235696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5b0babb4c944819a6bbe12fdd1a9ed)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:27.258155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.294548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 840/1694] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:27 2022] POST /identity/v3/projects => generated 391 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:27.295488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:27.471192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe0d8-cc43-4820-aaff-f4f1f47672f4 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.486468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.487522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.487522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.487889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.488555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:27.494363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.602294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5b0babb4c944819a6bbe12fdd1a9ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:27.624988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5b0babb4c944819a6bbe12fdd1a9ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:27.628159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5b0babb4c944819a6bbe12fdd1a9ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:27.647482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 841/1695] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:27 2022] POST /identity/v3/users => generated 296 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:27.648324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:27.672421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:27.756614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5b0babb4c944819a6bbe12fdd1a9ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:27.762205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5b0babb4c944819a6bbe12fdd1a9ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:27.801845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 855/1696] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:27 2022] DELETE /identity/v3/users/1e5b0babb4c944819a6bbe12fdd1a9ed => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:27.802891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:27.804393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:27.825242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06f45-b734-4f35-81d1-57ebcbe7ebba admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.926542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.927214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.928245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.928245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.931613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:27.934844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e925a9-0dd9-4f36-bccc-eb492cb65b88 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:27.957053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:27.957748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.958104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.958315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:27.959054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:27.968604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c291be-9923-4392-be19-897d2e66fbd9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:27.996677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 856/1697] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:27.997724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792bf2-e205-44e9-88d0-cce4bda547d0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:27.997802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792bf2-e205-44e9-88d0-cce4bda547d0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:27.998143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792bf2-e205-44e9-88d0-cce4bda547d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.043916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3f792bf2-e205-44e9-88d0-cce4bda547d0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:28.045314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3f792bf2-e205-44e9-88d0-cce4bda547d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.051545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.053017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:28.068218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 857/1698] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:28.068383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 842/1699] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:28.069915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.078728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.079022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.079307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.081822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022663f-39ad-4494-97f4-4d62230e3b0f service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:28.088923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:28.089684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.089974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.090257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.091049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.092786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:28.132045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 843/1700] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:28.132045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.132279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.158298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:28.159547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.266491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdecb57-579d-4626-a1ea-ffc73de103e5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:28.274805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 858/1701] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:28.276711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.278330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:28.279182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.280025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.281360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.306696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.307987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1115e68-2770-40b5-8be6-1d6d910cc957 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:28.310428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:28.321101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:28.322048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.322826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.323088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] PATH_INFO: `/v3/projects/647351bb0f694c62a31c151e6a1681a0/users/ed012a10d1c84ab39382d83d3eaf7e0d/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.336784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 844/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:28.338452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.342295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.363533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=647351bb0f694c62a31c151e6a1681a0, user_id=ed012a10d1c84ab39382d83d3eaf7e0d, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.371183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bfd56-3485-42ff-800b-db2531fae10c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:28.377509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73ea7a-42d3-41ec-9c7a-3205fa1e2069 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:28.399458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:28.400427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.406049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.407005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] PATH_INFO: `/v3/projects/82ab8738882a4a46b297f2221637275a` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.412609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ab8738882a4a46b297f2221637275a)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.414612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:28.521953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 859/1703] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:28 2022] PUT /identity/v3/projects/647351bb0f694c62a31c151e6a1681a0/users/ed012a10d1c84ab39382d83d3eaf7e0d/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:28.532658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.532948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.533248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.584279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] MFA Rules not processed for user `ed012a10d1c84ab39382d83d3eaf7e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:28.585620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.604550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ab8738882a4a46b297f2221637275a', 'request_id': 'req-56e781d1-d7d9-4543-91e7-64da18bfe613'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:28.622736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ab8738882a4a46b297f2221637275a', 'request_id': 'req-56e781d1-d7d9-4543-91e7-64da18bfe613'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:28.703360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 860/1704] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:28.709575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.762104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ab8738882a4a46b297f2221637275a', 'request_id': 'req-56e781d1-d7d9-4543-91e7-64da18bfe613'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:28.797746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] The token cache is being invalidate because project 82ab8738882a4a46b297f2221637275a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:28.798057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:28.816105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:28.821891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 845/1705] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:28 2022] DELETE /identity/v3/projects/82ab8738882a4a46b297f2221637275a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:28.823512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:28.827245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:28.933635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f984-651b-4616-91b9-844c77f48a82 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:28.951175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:28.951579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:28.951854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:28.952167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:28.952928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:28.958045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.000378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e781d1-d7d9-4543-91e7-64da18bfe613 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:29.005763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:29.006856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.009137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.009137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] PATH_INFO: `/v3/projects/fa0109207d3746c1a56d819f684f0b83` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.009137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0109207d3746c1a56d819f684f0b83)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:29.011915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.144208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 861/1706] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:28 2022] POST /identity/v3/projects => generated 391 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:29.145316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:29.156098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.181317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0109207d3746c1a56d819f684f0b83', 'request_id': 'req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.192418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0109207d3746c1a56d819f684f0b83', 'request_id': 'req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.295181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b135a10-8ab5-4643-8158-62706a35e223 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:29.339265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0109207d3746c1a56d819f684f0b83', 'request_id': 'req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.367100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] The token cache is being invalidate because project fa0109207d3746c1a56d819f684f0b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:29.368351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.371724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.374538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 846/1707] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:28 2022] DELETE /identity/v3/projects/fa0109207d3746c1a56d819f684f0b83 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:29.376906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:29.379152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.400009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:29.401275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.401559 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.402565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.404508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.460317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5da8b-d7ee-4b78-b6f0-353cc4e1629c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:29.466346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:29.467552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.467930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.468457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] PATH_INFO: `/v3/users/757255f767534207adcd52d56ed3fab6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.469791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757255f767534207adcd52d56ed3fab6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:29.471851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.474631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:29.476335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.492902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 862/1708] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:54:29.493817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:29.496152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.514101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b75bd-e677-4aaa-8a13-cd777d9a5ccd service swift] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:29.521136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:29.521906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.522277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.522610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.523552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:29.526279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583506-5886-41e6-84dc-ebc77dcb0e9f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.660818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 863/1709] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:29 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:29.662874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.664886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.665567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.707892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:29.712219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.745880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757255f767534207adcd52d56ed3fab6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.760187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 864/1710] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:29.766741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:29.770289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757255f767534207adcd52d56ed3fab6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.771375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757255f767534207adcd52d56ed3fab6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.777602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757255f767534207adcd52d56ed3fab6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.779638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:29.800020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac640a3-5cdb-4879-8e11-9c66a5e38151 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:29.810206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:29.812790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:29.813238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:29.813672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] PATH_INFO: `/v3/projects/f9a996d379a449c1b9375fbfa747c750` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:29.818444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a996d379a449c1b9375fbfa747c750)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:29.822668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:29.876674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757255f767534207adcd52d56ed3fab6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:29.911175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 847/1711] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:29 2022] DELETE /identity/v3/users/757255f767534207adcd52d56ed3fab6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:29.912035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:29.918898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.037151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a996d379a449c1b9375fbfa747c750', 'request_id': 'req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:30.053412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a996d379a449c1b9375fbfa747c750', 'request_id': 'req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:30.090484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff84a-f6e3-4fd1-8a95-9aa0af4cbf64 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:30.168424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a996d379a449c1b9375fbfa747c750', 'request_id': 'req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:30.187388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] The token cache is being invalidate because project f9a996d379a449c1b9375fbfa747c750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:30.187895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:30.189002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2f0821ff-51e6-4e8c-8d10-d43e9b32b811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:30.193114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 865/1712] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:29 2022] DELETE /identity/v3/projects/f9a996d379a449c1b9375fbfa747c750 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:30.198805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90196c9-0384-4878-b5b7-b3f4bba103a0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.200310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90196c9-0384-4878-b5b7-b3f4bba103a0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.200729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90196c9-0384-4878-b5b7-b3f4bba103a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.258050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a90196c9-0384-4878-b5b7-b3f4bba103a0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:30.263358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a90196c9-0384-4878-b5b7-b3f4bba103a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.388420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:30.389408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.389714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.390076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.391702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:30.393728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9827d-6c68-40a8-ad59-5b00903db837 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:30.427192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 848/1713] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:30.427192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.427192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.427192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.495072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 866/1714] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:30.498799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.498958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.499161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.511489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:30.512715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.573076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:30.600896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.600896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 867/1715] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:30.600896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:30.602954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.647352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0493e-44d4-4ffd-bc84-8f81b565b540 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:30.674116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:30.676651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.678365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 849/1716] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 5 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:30.678548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.679772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] PATH_INFO: `/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a/users/f2b36f823e73416884403f43f1a97f34/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.684850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:30.717976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efcf46-73e4-4a74-b324-03551481246f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:30.722989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:30.723764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.724047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.724408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.725334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:30.725641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:30.727359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492b78-d5dd-4f86-95b7-30a4a58d6f56 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:30.731897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a115c6f21a4f1ba40efe2cd02ff19a, user_id=f2b36f823e73416884403f43f1a97f34, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:30.734779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:30.775649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 850/1717] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:30.777005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e162d-1aec-49e7-9a8a-3840b6602a85 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.777289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e162d-1aec-49e7-9a8a-3840b6602a85 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.777570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e162d-1aec-49e7-9a8a-3840b6602a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:30.819185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f20e162d-1aec-49e7-9a8a-3840b6602a85 None None] MFA Rules not processed for user `3337cd0a90cb4d72b093f6a912295125`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:30.820532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f20e162d-1aec-49e7-9a8a-3840b6602a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:30.979617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 851/1718] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:30.981231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:30.981663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:30.982155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.021074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:31.021074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:31.050137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 852/1719] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:31.051188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.052622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:31.075622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7e3c-f33d-4b2e-9e89-63ba2578c07b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.081505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.082901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.083569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.084161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.114936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.118328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.152419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 853/1720] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:31.153837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.176098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 868/1721] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:30 2022] PUT /identity/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a/users/f2b36f823e73416884403f43f1a97f34/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:31.177408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.179208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67823a-3ad6-4b38-9857-9ac116f510ba service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.364942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.371792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.372247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.372633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.375511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.384194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.393811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b4b3-190a-4bcf-b16d-05a089579e74 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.414875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.415568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.418571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.418862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.419619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:31.419922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.421558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.460057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 869/1722] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:31.461902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.502277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9746-b4a4-4969-8778-304f2db5c0ba admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.537878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.537878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.537878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.537878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.538381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.538381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.542903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 854/1723] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:31 2022] POST /identity/v3/projects => generated 383 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:31.543948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.545885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:31.594054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 870/1724] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:31.598540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.621826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729842b-c0ff-4b82-bd99-4b55f2d55c6e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.725563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b69e-1708-4fc2-93b5-dc08312b0ccb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:31.734044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.734779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:31.735508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.735721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:31.736012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.736258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:31.736361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] PATH_INFO: `/v3/projects/fd95cbb3516345afb86a11927af4bebe` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.736752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:31.737711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd95cbb3516345afb86a11927af4bebe)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.737975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:31.739908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.740202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:31.854658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 871/1725] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:31 2022] POST /identity/v3/projects => generated 403 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:31.855797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:31.898775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd95cbb3516345afb86a11927af4bebe', 'request_id': 'req-8fec393f-bc4b-401d-ae26-2dc502140d76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:31.906780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd95cbb3516345afb86a11927af4bebe', 'request_id': 'req-8fec393f-bc4b-401d-ae26-2dc502140d76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:32.006962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf15bb-76f2-4d8b-93bd-9b22adc49ca2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.039306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd95cbb3516345afb86a11927af4bebe', 'request_id': 'req-8fec393f-bc4b-401d-ae26-2dc502140d76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:32.078576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] The token cache is being invalidate because project fd95cbb3516345afb86a11927af4bebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:32.080682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:32.084638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:32.093098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 855/1726] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:31 2022] DELETE /identity/v3/projects/fd95cbb3516345afb86a11927af4bebe => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:32.100096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.103921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.133518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.134356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.135058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.136641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.136641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.138988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.229548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec393f-bc4b-401d-ae26-2dc502140d76 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.235213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.236291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.236663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.237050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] PATH_INFO: `/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a/users/f2b36f823e73416884403f43f1a97f34/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.239247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a115c6f21a4f1ba40efe2cd02ff19a, user_id=f2b36f823e73416884403f43f1a97f34, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.242885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e08d7-affd-448f-8cdb-1df8f3b191f4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.264927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 872/1727] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:31 2022] POST /identity/v3/users => generated 292 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:32.264927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.267764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.287128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 856/1728] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:32 2022] PUT /identity/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a/users/f2b36f823e73416884403f43f1a97f34/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:32.287128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0908-a5d3-488d-afab-829e2278100c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.287128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0908-a5d3-488d-afab-829e2278100c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.287128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0908-a5d3-488d-afab-829e2278100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.294289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec69a2-7ff3-41da-b71f-4a8849e941fa admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.332460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-849b0908-a5d3-488d-afab-829e2278100c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:32.334989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-849b0908-a5d3-488d-afab-829e2278100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.437531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.438273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.438561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.438840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.439557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.446411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f6f53-0c9f-4719-b366-28f52ede7300 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.555645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 857/1729] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:32.558568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0908-a5d3-488d-afab-829e2278100c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.562907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-849b0908-a5d3-488d-afab-829e2278100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.574275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 873/1730] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:32 2022] POST /identity/v3/users => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:32.576144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.576701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.577227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.582225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0908-a5d3-488d-afab-829e2278100c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.589045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.593311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.593311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.593311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.593311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.593311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebd66c-b4f3-46f9-9f0e-ad13ed186844 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.613142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] MFA Rules not processed for user `f2b36f823e73416884403f43f1a97f34`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:32.614756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.621401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 858/1731] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:32.623445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.623975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.624260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.646921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:32.648221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.661078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 859/1732] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:32.661078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.674861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63cb49-5f1d-4bfa-a592-6403c2734bab None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.680587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.681594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.681937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.682378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.683251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.685205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.702294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 860/1733] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:32.703539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.718520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eed124-a272-41c3-bebf-a8ad11edb049 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.725204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.726758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.726969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.727377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.729257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.731193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.740036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 874/1734] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:32.742827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.762272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9120e-b129-4c06-8487-9704a69ddc72 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.764961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 861/1735] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:32.766070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.771146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.771146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.771146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.771146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.771722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:32.771722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.773860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.777587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e097-99e9-4dcf-9a20-b682a3427143 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.792247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 875/1736] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:32.798841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.802417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:32.807121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.807647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.807761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.808020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.809261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.811668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.832539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 862/1737] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:32.833595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.846934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b40ab-e694-430d-ac8a-d06d4bab3a08 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.852461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.854264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.854264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.854502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] PATH_INFO: `/v3/projects/03df0a7378ef423a954adf95715edf63/users/81649fb2d2c748b39555459ace617b03/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.881311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03df0a7378ef423a954adf95715edf63, user_id=81649fb2d2c748b39555459ace617b03, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.884319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709d75-aac3-4258-b089-01b6cf22ae60 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.913010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde0ee2-07da-4b04-a0bd-01f277548a47 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:32.917656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:32.918854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.919714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:32.920156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:32.943560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:32.945723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:32.970438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 876/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:32.971494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:32.984140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 863/1739] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:32 2022] PUT /identity/v3/projects/03df0a7378ef423a954adf95715edf63/users/81649fb2d2c748b39555459ace617b03/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:32.997674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44699c-940e-4f4e-bcc3-ae36153a37a3 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:32.997970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44699c-940e-4f4e-bcc3-ae36153a37a3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.002329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44699c-940e-4f4e-bcc3-ae36153a37a3 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.004406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a86d-62c6-45c7-82da-6b8d864306d4 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:33.017903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 864/1740] 10.222.0.26 () {54 vars in 912 bytes} [Thu May 5 13:54:32 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:33.018909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44699c-940e-4f4e-bcc3-ae36153a37a3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:33.144081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:33.144679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.144963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.145235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.145961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:33.147935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359cff-c4b5-45dd-a388-9f74860be044 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:33.154382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44699c-940e-4f4e-bcc3-ae36153a37a3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:33.169948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:33.170881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.171159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.171451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] PATH_INFO: `/v3/projects/213f5512d8444094be26f06a97a6fef6/users/8ef86f2b86674b83829e5633e4da6016/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.202917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213f5512d8444094be26f06a97a6fef6, user_id=8ef86f2b86674b83829e5633e4da6016, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:33.208745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62443-cdc6-4207-b0c4-d2b075fc1f34 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:33.285337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 865/1741] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:33 2022] PUT /identity/v3/projects/213f5512d8444094be26f06a97a6fef6/users/8ef86f2b86674b83829e5633e4da6016/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:33.287937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.288411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.288750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 877/1742] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:32 2022] POST /identity/v3/projects => generated 371 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:33.289228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.290677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.290998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.291272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.377755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:33.378801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:33.502282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 878/1743] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:33.503240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:33.604394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] MFA Rules not processed for user `81649fb2d2c748b39555459ace617b03`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:33.605861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23658-6406-4065-900f-3443bbdb40b3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:33.607021 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:33.609950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:33.610671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.610990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.611274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.613463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:33.739770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:33.741600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d362e-9f8e-4f6f-ab31-26b3eddcb117 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:33.761967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 866/1744] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:33.762925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:33.769348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 879/1745] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:33.773391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:33.778953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:33.779598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:33.838192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] MFA Rules not processed for user `8ef86f2b86674b83829e5633e4da6016`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:33.840181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:33.993366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 880/1746] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:33.995053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:33.998854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:34.020922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6ea2-80fd-40ec-b817-af4882901a70 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.023876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afacf-9a85-4271-860d-6eebea8df24e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.035142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.036032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.037340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.038514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.038932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.040635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.046767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.054148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.059814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.059934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.059934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.060083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.088079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 881/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:34.089297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.116987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a03a9-48d2-4bfe-a22a-fdb14a8de12c service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.135174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.135174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.135174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.135174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.135579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.135579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86777-5ff2-4b36-839e-4e3f6df76bed admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.266175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 867/1748] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:33 2022] POST /identity/v3/users => generated 286 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:34.267234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.289037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52c51-d742-43dd-b5e9-595a162ba3ec admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.293976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.294691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.294996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.295381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.296066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.298164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.369949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 882/1749] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:34.371401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691794-ebb6-4138-8aa0-9dc733b49547 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.371691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691794-ebb6-4138-8aa0-9dc733b49547 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.371970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691794-ebb6-4138-8aa0-9dc733b49547 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.373529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 883/1750] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:34.374302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691794-ebb6-4138-8aa0-9dc733b49547 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.465977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 868/1751] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:34 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:34.465977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.477330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691794-ebb6-4138-8aa0-9dc733b49547 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.561454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.562177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.562462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.562785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.563579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.565512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fbd51-b413-4d72-a2f3-02b2ba195018 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.577223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 884/1752] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:34.579476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.586903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.586903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.591888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abc81-2013-47bd-9c36-29cf80924a37 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.605450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.606595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.606595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.606959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.607762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.613421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.622504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:34.622504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:34.724647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 869/1753] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:34 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:34.724647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.732981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4667514-30d4-4e55-b4cc-4f03f4e17d08 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.736137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 885/1754] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:34.738229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.751795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.752918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.753304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.753683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.755843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.760974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.764731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a769-b096-4124-b094-8dc204d9e006 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.772656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.773553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.773973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.774499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.775786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.777668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.797204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 886/1755] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:34.798122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.831871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68528d-aa55-4c62-b186-598d1cd998b4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.837272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.838318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.838713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.839039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.839849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.841470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.857362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 887/1756] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:34.858862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.861039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 870/1757] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:34 2022] POST /identity/v3/users => generated 308 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:34.861204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:34.864821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.880722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b528c-9cac-4440-b9ce-ff43d8c10ac8 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.888771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.889444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.889730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.890098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.890318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db172066-770b-414a-a8fb-91539bb7d650 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.897260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.898702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.899100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.899466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] PATH_INFO: `/v3/projects/5d1c49ed681a48558eb679ed290b8c39/users/5691356782af47a29af6e39dee37e325/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:34.900720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.902471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.924664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c49ed681a48558eb679ed290b8c39, user_id=5691356782af47a29af6e39dee37e325, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:34.927429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:34.930455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 888/1758] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:34.931985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:34.947804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd9a55-ccd7-48ae-90c3-8f6aaa2d8c03 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:34.958628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:34.958628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:34.958628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:34.958628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] PATH_INFO: `/v3/projects/276fbb28f81547d388f3616964f2b98b/users/ff869f368aa347cf852f1074a2d6765b/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.020414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276fbb28f81547d388f3616964f2b98b, user_id=ff869f368aa347cf852f1074a2d6765b, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.026244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27217f1e-d084-460e-8b06-9c849b765477 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.064581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 871/1759] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:34 2022] PUT /identity/v3/projects/5d1c49ed681a48558eb679ed290b8c39/users/5691356782af47a29af6e39dee37e325/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:35.064581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.126165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 889/1760] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:34 2022] PUT /identity/v3/projects/276fbb28f81547d388f3616964f2b98b/users/ff869f368aa347cf852f1074a2d6765b/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:35.132065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.132449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.132776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.220726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb013-4a3b-4e84-bb7c-c713650284e5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.224805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:35.243162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:35.346311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.346927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.347213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.347481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.349122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.352698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba907c-7dea-4cfe-87ba-9c8c8fa1af52 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.366613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 890/1761] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:35.368025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.394613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 872/1762] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:35.396675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.396972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.397253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.435980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7787234-9cb9-4d38-9bd4-4b7fe6c07b51 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.445688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.446517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.447007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.447449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.448317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.450072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.458291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] MFA Rules not processed for user `add9c19abc0a46feb0be090a9a6641c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:35.459537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:35.466291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 891/1763] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:35.467306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.576831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 873/1764] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:35.578056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.598254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5953-1c30-4176-af5e-6680142f8b12 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.598254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.598254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.598254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.598631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.609778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.611718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.619963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9a22-2fc4-49c7-af04-8eb0efcc1bc0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.627472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 892/1765] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:35.628346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.641672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.642695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.642909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.643225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] PATH_INFO: `/v3/projects/41fb5555d32240ef8a5b327e4038ae96/users/3c33031174034d39b0270f02a2bf9009/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.647112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd300c9-0fb7-48bb-8e23-aa8eff37a392 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.663070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.664467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.664850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.665220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] PATH_INFO: `/v3/projects/276fbb28f81547d388f3616964f2b98b/users/ff869f368aa347cf852f1074a2d6765b/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.669093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276fbb28f81547d388f3616964f2b98b, user_id=ff869f368aa347cf852f1074a2d6765b, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.673120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3364b0-f97c-4b46-b3a9-e02a5deacd71 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.694507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 893/1766] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:35 2022] PUT /identity/v3/projects/276fbb28f81547d388f3616964f2b98b/users/ff869f368aa347cf852f1074a2d6765b/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:35.702879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fb5555d32240ef8a5b327e4038ae96, user_id=3c33031174034d39b0270f02a2bf9009, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.703042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.703536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.704015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.706784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.748945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] MFA Rules not processed for user `ff869f368aa347cf852f1074a2d6765b`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:35.750251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:35.821254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 894/1767] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:35.841033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 874/1768] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:35 2022] PUT /identity/v3/projects/41fb5555d32240ef8a5b327e4038ae96/users/3c33031174034d39b0270f02a2bf9009/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:35.843106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.846379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.911879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d469d-2549-48f1-8312-c3da919dddf8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.920301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941726d-d789-4958-8a53-f69de536d5b0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.925542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.926439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.926875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.927349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.928225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.930295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.940869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 875/1769] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:35.946433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:35.960119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae024ba7-c5e6-4c97-8148-2579b02704b4 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:35.967696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.968256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.968538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.968811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] PATH_INFO: `/v3/projects/41fb5555d32240ef8a5b327e4038ae96/users/3c33031174034d39b0270f02a2bf9009/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.972023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fb5555d32240ef8a5b327e4038ae96, user_id=3c33031174034d39b0270f02a2bf9009, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:35.974795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273eddd0-f6d5-42b7-8cd6-cd295ccc7038 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:35.980985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:35.981807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.982138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.982410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:35.987703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 876/1770] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:35 2022] PUT /identity/v3/projects/41fb5555d32240ef8a5b327e4038ae96/users/3c33031174034d39b0270f02a2bf9009/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:35.997780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:35.998092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:35.998368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.046666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] MFA Rules not processed for user `3c33031174034d39b0270f02a2bf9009`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:36.047782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:36.065913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:36.067543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:36.090447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 895/1771] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:36.127307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:36.131162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 877/1772] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:36.138607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e77a05-a4df-4581-bfcc-4b170b7ef0f7 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:36.140461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:36.141955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:36.212002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8311772-ca62-4c8c-a5de-f6cbaf5e8414 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:36.216426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:36.217081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:36.217365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:36.217654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.228104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:36.230153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddc609-2ac5-4bfe-bbf5-383daaa81a2a service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:36.230759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:36.231921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:36.232361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:36.232792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] PATH_INFO: `/v3/users/81649fb2d2c748b39555459ace617b03` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.234699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81649fb2d2c748b39555459ace617b03)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:36.237240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:36.263278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 878/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:36.438865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81649fb2d2c748b39555459ace617b03'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:36.446848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81649fb2d2c748b39555459ace617b03'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:36.447541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81649fb2d2c748b39555459ace617b03'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:36.550361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81649fb2d2c748b39555459ace617b03'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:36.551034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81649fb2d2c748b39555459ace617b03'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:36.574509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 896/1774] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:36 2022] DELETE /identity/v3/users/81649fb2d2c748b39555459ace617b03 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:36.579171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:36.579454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:36.579725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.624268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:36.626342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:36.665272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:36.672196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:36.767730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 879/1775] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:36.785078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:36.785078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:36.788981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2116-0158-49a9-be99-dc1cf02479b3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:36.807752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:36.807752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:36.807752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:36.807752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] PATH_INFO: `/v3/users/8ef86f2b86674b83829e5633e4da6016` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.808230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef86f2b86674b83829e5633e4da6016)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:36.808230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:36.874607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92f569-f336-4cf6-8f37-92a60696cd4c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:36.897767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:36.899495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:36.904495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:36.904495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:36.940172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:36.943110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271de8-a7fa-4f3e-9909-40dc0c7c6d5a service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:36.975351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 880/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:37.116261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef86f2b86674b83829e5633e4da6016'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:37.128973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef86f2b86674b83829e5633e4da6016'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:37.131213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef86f2b86674b83829e5633e4da6016'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:37.262698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef86f2b86674b83829e5633e4da6016'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:37.263413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef86f2b86674b83829e5633e4da6016'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:37.290972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 897/1777] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:36 2022] DELETE /identity/v3/users/8ef86f2b86674b83829e5633e4da6016 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:37.297156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:37.297743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:37.298141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:37.333732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:37.335362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:37.555900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 881/1778] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:37.603822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:37.605547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:37.741237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144785d2-6f2b-4bcf-a357-529cb2236ba5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:37.749953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:37.750673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:37.750955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:37.751232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:37.773276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:37.775920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c8eca-d3c7-4e6f-b9cf-60657de326bc service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:37.798285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 898/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:38.222240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:38.224009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:38.242107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd811d-ee47-474b-993b-f38d891636ee None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:38.294109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:38.295029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:38.295392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:38.295604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] PATH_INFO: `/v3/projects/03df0a7378ef423a954adf95715edf63` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:38.315465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03df0a7378ef423a954adf95715edf63)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:38.323056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:38.606887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03df0a7378ef423a954adf95715edf63', 'request_id': 'req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:38.620538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03df0a7378ef423a954adf95715edf63', 'request_id': 'req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:38.691179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:38.691765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:38.691765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:38.768246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] MFA Rules not processed for user `5691356782af47a29af6e39dee37e325`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:38.769948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:38.865312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03df0a7378ef423a954adf95715edf63', 'request_id': 'req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:38.891829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] The token cache is being invalidate because project 03df0a7378ef423a954adf95715edf63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:38.892184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:38.893452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:38.895452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 882/1780] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:38 2022] DELETE /identity/v3/projects/03df0a7378ef423a954adf95715edf63 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:38.899539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:38.901804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:38.912234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 899/1781] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:38.918176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:38.920424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:39.085315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36277f2-0aa7-4a4d-9509-9cbdfefd915d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:39.099995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:39.100877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:39.101247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:39.101591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] PATH_INFO: `/v3/users/ff869f368aa347cf852f1074a2d6765b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:39.109204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff869f368aa347cf852f1074a2d6765b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:39.111570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:39.170076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc21ed-4a55-4e22-9e05-5b73f6eb53b0 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:39.184139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:39.193804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:39.193804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:39.193804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:39.193804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:39.193804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:39.390357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 900/1782] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:39.391508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:39.394840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:39.449981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff869f368aa347cf852f1074a2d6765b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.468566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff869f368aa347cf852f1074a2d6765b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.469750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff869f368aa347cf852f1074a2d6765b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.470693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff869f368aa347cf852f1074a2d6765b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.536744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462866a-09b0-4da3-9ee0-8a8132232ea3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:39.541766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:39.542682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:39.542965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:39.543312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] PATH_INFO: `/v3/projects/213f5512d8444094be26f06a97a6fef6` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:39.551092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213f5512d8444094be26f06a97a6fef6)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:39.551092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:39.578915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff869f368aa347cf852f1074a2d6765b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.599479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 883/1783] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:38 2022] DELETE /identity/v3/users/ff869f368aa347cf852f1074a2d6765b => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:39.600467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:39.607464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:39.674110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213f5512d8444094be26f06a97a6fef6', 'request_id': 'req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.687431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213f5512d8444094be26f06a97a6fef6', 'request_id': 'req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.762359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213f5512d8444094be26f06a97a6fef6', 'request_id': 'req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.781323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb82f5e-dab3-4599-95fd-25346a03c34e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:39.785214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] The token cache is being invalidate because project 213f5512d8444094be26f06a97a6fef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:39.785510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.792524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:39.802517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 901/1784] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:39 2022] DELETE /identity/v3/projects/213f5512d8444094be26f06a97a6fef6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:39.807919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:39.809516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:39.920144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc85ab-3783-49e9-800c-c9ee8cd82dd4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:39.928178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:39.929117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:39.929675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:39.930129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] PATH_INFO: `/v3/users/3c33031174034d39b0270f02a2bf9009` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:39.931517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c33031174034d39b0270f02a2bf9009)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:39.932305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:39.933152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:39.934199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:39.936286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:39.936734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:39.937805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:39.943145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:40.141518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 884/1785] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:39 2022] POST /identity/v3/users => generated 293 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:40.145911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:40.153707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:40.160575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c33031174034d39b0270f02a2bf9009'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:40.181713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c33031174034d39b0270f02a2bf9009'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:40.182920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c33031174034d39b0270f02a2bf9009'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:40.185384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf67a1e-d7b9-4398-b659-f1254ee44192 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:40.209132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:40.226885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:40.227271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:40.227672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:40.229129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:40.232914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:40.265514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 885/1786] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:40.265514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:40.265514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:40.295115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49b3a-9741-497f-bd93-4c6bf620d82d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:40.301597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:40.302637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:40.303031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:40.303389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] PATH_INFO: `/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05/users/d724cd35cfd1410bb828ed4c976e45f6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:40.328008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c33031174034d39b0270f02a2bf9009'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:40.328944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c33031174034d39b0270f02a2bf9009'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:40.335973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a4f727b2ad4c0a829c93a7ea14aa05, user_id=d724cd35cfd1410bb828ed4c976e45f6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:40.344436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:40.363939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 902/1787] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:39 2022] DELETE /identity/v3/users/3c33031174034d39b0270f02a2bf9009 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:40.479131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 886/1788] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:40 2022] PUT /identity/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05/users/d724cd35cfd1410bb828ed4c976e45f6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:40.483614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:40.659545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39550d-aff3-4b0d-a84d-522a4c0df17d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:40.779521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:40.782698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:40.783644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:40.784877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:40.787299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:40.789674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:40.810316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 903/1789] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:40.815881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:40.836840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7a8c-95a6-4768-9388-4a90e92ff948 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:40.856722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:40.858221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:40.858680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:40.859081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] PATH_INFO: `/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05/users/d724cd35cfd1410bb828ed4c976e45f6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:40.863217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a4f727b2ad4c0a829c93a7ea14aa05, user_id=d724cd35cfd1410bb828ed4c976e45f6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:40.867797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854b29-9fa2-457b-b5cd-6da1578ff9c0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:40.892360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 887/1790] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:40 2022] PUT /identity/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05/users/d724cd35cfd1410bb828ed4c976e45f6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:41.164629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:41.167315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:41.193533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b0f4-c5c7-444f-b78d-144b4f251e7f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:41.327805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:41.328685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:41.328959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:41.329276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] PATH_INFO: `/v3/projects/276fbb28f81547d388f3616964f2b98b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:41.338881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=276fbb28f81547d388f3616964f2b98b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:41.340877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:41.504564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276fbb28f81547d388f3616964f2b98b', 'request_id': 'req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:41.522257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276fbb28f81547d388f3616964f2b98b', 'request_id': 'req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:41.642331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276fbb28f81547d388f3616964f2b98b', 'request_id': 'req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:41.659940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] The token cache is being invalidate because project 276fbb28f81547d388f3616964f2b98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:41.660441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:41.670955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:41.674255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 904/1791] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:41 2022] DELETE /identity/v3/projects/276fbb28f81547d388f3616964f2b98b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:41.679401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceb4-0306-4e81-bc10-26f41cb2c92d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:41.680322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceb4-0306-4e81-bc10-26f41cb2c92d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:41.680734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceb4-0306-4e81-bc10-26f41cb2c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:41.740071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-741aceb4-0306-4e81-bc10-26f41cb2c92d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:41.742457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-741aceb4-0306-4e81-bc10-26f41cb2c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:41.765088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:41.766789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:41.863614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 888/1792] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:41.876603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:41.877664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:41.878413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:41.879759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59b4e-531d-41b0-97aa-fd5921c0a8ca admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:41.898005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:41.899036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:41.899972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:41.900620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] PATH_INFO: `/v3/users/ed012a10d1c84ab39382d83d3eaf7e0d` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:41.909818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed012a10d1c84ab39382d83d3eaf7e0d)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:41.909818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:41.935084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:41.936321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:41.957346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 889/1793] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:41.966502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:41.966502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:42.017088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07711bfa-b05e-447c-b3cc-ee063c3b3b96 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:42.039634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:42.041655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:42.041655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:42.041891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] PATH_INFO: `/v3/projects/41fb5555d32240ef8a5b327e4038ae96` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:42.054254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fb5555d32240ef8a5b327e4038ae96)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:42.054254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:42.799476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed012a10d1c84ab39382d83d3eaf7e0d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:42.806361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed012a10d1c84ab39382d83d3eaf7e0d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:42.807058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed012a10d1c84ab39382d83d3eaf7e0d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:42.877763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fb5555d32240ef8a5b327e4038ae96', 'request_id': 'req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:42.884846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fb5555d32240ef8a5b327e4038ae96', 'request_id': 'req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:42.996754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed012a10d1c84ab39382d83d3eaf7e0d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:43.001955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed012a10d1c84ab39382d83d3eaf7e0d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:43.024805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 905/1794] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:41 2022] DELETE /identity/v3/users/ed012a10d1c84ab39382d83d3eaf7e0d => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:43.025800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.028423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.103738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f439-75b6-406d-ac52-9262b1cb532b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.108543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.111150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.111150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.111150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.111150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:43.111545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.113104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0969c-cb74-4600-ac46-bca2cd6ad336 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.129363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 906/1795] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:43.130875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.131165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.131444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.150499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:43.151711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.156550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fb5555d32240ef8a5b327e4038ae96', 'request_id': 'req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:43.160167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 907/1796] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:43.163861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.173374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] The token cache is being invalidate because project 41fb5555d32240ef8a5b327e4038ae96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:43.173663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:43.174431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:43.174584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd752d-646a-42e0-9751-8736fa4a45a8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.176382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 890/1797] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:41 2022] DELETE /identity/v3/projects/41fb5555d32240ef8a5b327e4038ae96 => generated 0 bytes in 1219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:43.177593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.179292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.180227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.180967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.181380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.181781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.182707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.184731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be0c71-aee6-47c6-b4e2-061d579563b2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.264874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 908/1798] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:43.266602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.267153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.267642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.274693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfc31-bad2-4a7a-a934-16bbd8b3ba5e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.296408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:43.298552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.331975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.333029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.333535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.334042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.338072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.387628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 909/1799] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:43.388744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.390811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.406164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202b47-c050-4668-9031-c486fc5b7710 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.412335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.413012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.413291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.413607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.414342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.416443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.427181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.430523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853052a-20d0-4061-993a-70f2e9f0f65f service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.440169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 891/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:43.441732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edcbeb-8093-4c41-a207-370126e034be None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.442127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edcbeb-8093-4c41-a207-370126e034be None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.442501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edcbeb-8093-4c41-a207-370126e034be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.461836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-54edcbeb-8093-4c41-a207-370126e034be None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:43.463685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-54edcbeb-8093-4c41-a207-370126e034be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:43.474065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 892/1801] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:43.476210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edcbeb-8093-4c41-a207-370126e034be None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.486866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edcbeb-8093-4c41-a207-370126e034be None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.495285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.495966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.496247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.496522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.497262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:43.497801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.499584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.514076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 893/1802] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:54:43.517413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.530491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db9b12-d257-4a24-ad4c-82632395f801 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.535841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.536576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.536918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.537245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.538634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.540241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.562075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 910/1803] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:43.565009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.577849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73595-8f40-495c-a716-55cd5c3c7304 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.585330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.586053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.586342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.586617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.587490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.589097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.599870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 911/1804] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:43.603728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.618082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704a66-9c1a-467e-8850-9092d33b9ac6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.625872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.626631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.626947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.627346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.628455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.630964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.647831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 912/1805] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:43.652875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.657168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 894/1806] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:43.661502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.671868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376831e-7dfd-4d94-8366-6ea6df4de015 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.740751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.741731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.742111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.742455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] PATH_INFO: `/v3/projects/683c9d04e6c944958a832b4b225ae935/users/203d7d72d0e64520af319b63f816f0e7/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.747725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757df5-98ed-423c-8a7d-b081314652bd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:43.752585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:43.753372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.753849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.753964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:43.754653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.756551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6fc3-95eb-484e-9eb7-c0b1535c0fe8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.760023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c9d04e6c944958a832b4b225ae935, user_id=203d7d72d0e64520af319b63f816f0e7, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:43.761987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:43.924282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 913/1807] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:43 2022] PUT /identity/v3/projects/683c9d04e6c944958a832b4b225ae935/users/203d7d72d0e64520af319b63f816f0e7/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:43.928299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 895/1808] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/users => generated 279 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:43.931977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:43.938287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:43.938699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:43.939102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.001184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] MFA Rules not processed for user `203d7d72d0e64520af319b63f816f0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:44.006134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.138781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af569d56-ef36-49ff-bc0e-a43261924f1f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.156779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.157549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.158155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.159320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.161106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:44.170787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:44.215456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 914/1809] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:44.216674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:44.233545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3723296-fa27-4833-897e-4d889b247bce admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.250831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.251678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.252106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.252511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.253439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:44.255828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 896/1810] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:44.257960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:44.277188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:44.282100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.309499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 915/1811] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:44.309499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:44.315365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54c6e4-7100-406b-b2ad-2899995b4295 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.332573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.334239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.334689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.335254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] PATH_INFO: `/v3/projects/80ae875b007f4c2d8fb195ace6dd8a3b/users/71eeb62bfa994693b663cae7c267f47f/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.366632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ae875b007f4c2d8fb195ace6dd8a3b, user_id=71eeb62bfa994693b663cae7c267f47f, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:44.379789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7426b-aa0f-4dbc-999e-2d7273fa4067 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:44.422991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe75d7-c4bb-4a86-9f4b-eccce9b2f0fe None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.429459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.430404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.430893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.431372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.441065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:44.442957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a5429-b00b-4581-b5fc-00e4cfb4e32c service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:44.470059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 916/1812] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:44 2022] PUT /identity/v3/projects/80ae875b007f4c2d8fb195ace6dd8a3b/users/71eeb62bfa994693b663cae7c267f47f/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:44.473392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.473707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.473992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.488759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 897/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:44.490511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.494446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.494446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.542564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] MFA Rules not processed for user `d724cd35cfd1410bb828ed4c976e45f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:44.543910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.590217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] MFA Rules not processed for user `71eeb62bfa994693b663cae7c267f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:44.592942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.700315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 917/1814] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:44.701997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:44.705781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.803292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 898/1815] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:44.808609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:44.811318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:44.901088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde39c-e99c-49bc-b3ea-5f04410e5f51 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.909494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.910871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709768-dbe9-404a-9985-ec3d703af929 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:44.911773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.912116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.913003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] PATH_INFO: `/v3/projects/647351bb0f694c62a31c151e6a1681a0` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.914483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=647351bb0f694c62a31c151e6a1681a0)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:44.917238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:44.917906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:44.918744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:44.919323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:44.919706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:44.922447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:45.020756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:45.022773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:45.038706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 899/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:45.060208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:45.083025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647351bb0f694c62a31c151e6a1681a0', 'request_id': 'req-d44013d4-3f71-4873-b5d9-005a7eded0ea'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.085992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d8647-c998-4011-8265-7cecf1b4355a service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:45.107683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647351bb0f694c62a31c151e6a1681a0', 'request_id': 'req-d44013d4-3f71-4873-b5d9-005a7eded0ea'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.177766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:45.178610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.178889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.179159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.179847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:45.182278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb6e9-fd14-4dce-a4a1-00443080c08e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:45.247439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647351bb0f694c62a31c151e6a1681a0', 'request_id': 'req-d44013d4-3f71-4873-b5d9-005a7eded0ea'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.259273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] The token cache is being invalidate because project 647351bb0f694c62a31c151e6a1681a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d44013d4-3f71-4873-b5d9-005a7eded0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 918/1817] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:44 2022] DELETE /identity/v3/projects/647351bb0f694c62a31c151e6a1681a0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.264801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.265448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 919/1818] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:54:45.266189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:45.267754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:45.283189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece933c4-2adb-484d-92d6-9fef2a3e0ede None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:45.298074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 900/1819] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:45 2022] POST /identity/v3/projects => generated 357 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:45.298074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.298074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.298420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.299596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:45.300470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.300746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.301015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] PATH_INFO: `/v3/users/f2b36f823e73416884403f43f1a97f34` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.303073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b36f823e73416884403f43f1a97f34)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:45.305069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:45.332597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:45.334167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:45.444226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 901/1820] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:45.444949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:45.446356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:45.578050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c9a1-5f94-4bff-baeb-caeca75c5357 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:45.593937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:45.593937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.593937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.593937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.594536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:45.594536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:45.636952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b36f823e73416884403f43f1a97f34'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.674420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b36f823e73416884403f43f1a97f34'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.679068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b36f823e73416884403f43f1a97f34'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.751498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 902/1821] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:45 2022] POST /identity/v3/users => generated 285 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:45.755183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:45.757209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:45.782450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b36f823e73416884403f43f1a97f34'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.783978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b36f823e73416884403f43f1a97f34'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:45.786758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdfbaf-a911-43d0-a59d-d45cdba5f4e4 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:45.799347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:45.800197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:45.800605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:45.801003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:45.805610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:45.805610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:45.832917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 903/1822] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:45.841487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 920/1823] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:45 2022] DELETE /identity/v3/users/f2b36f823e73416884403f43f1a97f34 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:45.844155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:45.895700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903771-6752-4f97-9422-2b9796b7cf53 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.045232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.045232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.046175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.046175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] PATH_INFO: `/v3/projects/6636b56f101547018a76345609369cb2/users/76586bd3b0984124bf0c5953a6880f47/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.087362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6636b56f101547018a76345609369cb2, user_id=76586bd3b0984124bf0c5953a6880f47, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.089814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:46.091216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:46.108363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:46.200945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d5d1b-3bb6-4b42-9563-8f542f7fd03d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.214522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.216009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.216451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.216825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.219319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:46.238301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 904/1824] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:45 2022] PUT /identity/v3/projects/6636b56f101547018a76345609369cb2/users/76586bd3b0984124bf0c5953a6880f47/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:46.241516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:46.244351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.246391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:46.259425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 921/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:46.370320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebe0a-4b82-4104-860b-0415e195de68 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.375377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.376089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.376364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.376636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.377416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.379205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279263-43cb-44ff-bfcf-9fac926ad4f0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:46.389957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 905/1826] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:46.394149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:46.404839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb91e-3ec7-4781-a64d-09b433697166 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.409397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.410326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.410603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.410869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] PATH_INFO: `/v3/projects/6636b56f101547018a76345609369cb2/users/76586bd3b0984124bf0c5953a6880f47/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.412834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6636b56f101547018a76345609369cb2, user_id=76586bd3b0984124bf0c5953a6880f47, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.416227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:46.427345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 922/1827] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:46 2022] PUT /identity/v3/projects/6636b56f101547018a76345609369cb2/users/76586bd3b0984124bf0c5953a6880f47/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:46.438816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.438816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.438816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.468310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] MFA Rules not processed for user `76586bd3b0984124bf0c5953a6880f47`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:46.469498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:46.537919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 906/1828] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:46.549780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:46.551522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:46.608399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:46.610097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:46.629519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd5122-687b-46ad-ad8d-2d504858f1ca admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.633342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.634137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.634574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.635583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.652907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.654448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:46.666161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 923/1829] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:46.718722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8c0d-c57b-4845-b212-f7b11d534413 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:46.723685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:46.724706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:46.725061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:46.725409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] PATH_INFO: `/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:46.726839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a115c6f21a4f1ba40efe2cd02ff19a)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:46.729391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:47.012774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a115c6f21a4f1ba40efe2cd02ff19a', 'request_id': 'req-4277d5ed-a747-4fde-9301-cb000d001d73'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:47.021549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a115c6f21a4f1ba40efe2cd02ff19a', 'request_id': 'req-4277d5ed-a747-4fde-9301-cb000d001d73'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:47.049181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:47.061225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330458-d1a3-42cd-9e6d-883297ee529f service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:47.140103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:47.141048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:47.141429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:47.141799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:47.147433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:47.176969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a115c6f21a4f1ba40efe2cd02ff19a', 'request_id': 'req-4277d5ed-a747-4fde-9301-cb000d001d73'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:47.193723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] The token cache is being invalidate because project 22a115c6f21a4f1ba40efe2cd02ff19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:47.194007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:47.194833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4277d5ed-a747-4fde-9301-cb000d001d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:47.200551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 907/1830] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:46 2022] DELETE /identity/v3/projects/22a115c6f21a4f1ba40efe2cd02ff19a => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:47.202008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:47.202322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:47.202596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:47.226444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:47.227619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:47.243489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:47.245690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96b36f-e4bf-433d-9ce7-556a31da4c36 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:47.258124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 924/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:47.314505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 908/1832] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:47.316576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:47.317433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:47.318036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:47.341038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:47.342343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:47.355858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 925/1833] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:47.360172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:47.374345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f337d-46a3-4808-b47e-7a36e8070bc1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:47.380964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:47.381885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:47.387858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:47.387858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:47.387858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:47.387858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:47.387858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:47.401656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 909/1834] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:47.406684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:47.418906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9aab6-a385-4d9b-8810-27c728def883 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:47.423879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:47.424579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:47.424862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:47.425131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:47.425921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:47.428139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:48.447813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:48.449584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:48.456987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 926/1835] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:47 2022] POST /identity/v3/projects => generated 387 bytes in 1048 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:48.459723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:48.475896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bde5d7-466c-4cae-a9d4-aec32755c702 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:48.542698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7d40-e3be-46dd-95e0-f4a2a1dd58d5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:48.547630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:48.548488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.548866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.549261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.550210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:48.553490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb8793-f81c-4050-99fc-d8d20a55b320 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:48.557436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:48.558529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.559086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.560019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.562312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:48.629234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:48.633395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:48.643053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 910/1836] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:48.698343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 927/1837] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:48 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:48.702425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:48.713697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a5d9-6be2-450b-a274-2b88138aeb56 None None] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.714073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a5d9-6be2-450b-a274-2b88138aeb56 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.714578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a5d9-6be2-450b-a274-2b88138aeb56 None None] PATH_INFO: `/` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.716865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 928/1838] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:54:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:54:48.726460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d1e1-5820-4e86-a824-4a97c07b7bc9 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:48.737290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:48.747701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.753489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.753883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.756422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:48.764858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:48.777245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.777743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.778309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.807391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:48.808749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:48.814049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 911/1839] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:48.817758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:48.851058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041076fa-711d-4cf5-8c59-46c91a5ed339 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:48.859982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:48.860849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.861263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.861695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.862619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:48.864608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:48.876978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 912/1840] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:48.881151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:48.896452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd6d1c-7621-493a-b0ec-f28f4695d222 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:48.903754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:48.904862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:48.905270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:48.905731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] PATH_INFO: `/v3/projects/5a302bb22aae4829bc5e2b2302be893f/users/b3f13c6657a44ceeb8231a2fb2f5d600/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:48.913292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 929/1841] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:48.925874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a302bb22aae4829bc5e2b2302be893f, user_id=b3f13c6657a44ceeb8231a2fb2f5d600, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:48.929632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26ae8-0211-46bf-8a57-6c0a45375b32 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.011037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.016254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:49.028945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d3ab5-f9e2-4b71-a7a0-10c8fe0d9d11 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.034820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.035611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.035955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.038093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.044468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 913/1842] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:48 2022] PUT /identity/v3/projects/5a302bb22aae4829bc5e2b2302be893f/users/b3f13c6657a44ceeb8231a2fb2f5d600/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:49.053961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.054292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.054570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.059990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.061622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.092095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 930/1843] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:49.112410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] MFA Rules not processed for user `b3f13c6657a44ceeb8231a2fb2f5d600`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:49.115838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:49.200197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 914/1844] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:49.214333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.224719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30ddf-18b8-4bda-87cc-d1d4216e5b1c service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.280902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.281554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.281827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.282133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.282827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.284710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.403152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 931/1845] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:49 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:49.407191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.418834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61778f0-a4a1-4f27-8dfb-25b431381016 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.476088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.476761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.477041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.477314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.478560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.480533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.612998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 915/1846] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:49 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:49.616953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.627218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd183c-22f0-4858-b3c1-9756b193e76c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.631771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.632423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.632705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.632979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.633702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.635377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.645782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 932/1847] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:49.650356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.660295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12a34f-e395-4475-bdc8-ca25385ed02c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.665135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.666613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.666888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.667159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] PATH_INFO: `/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296/users/3444676894d54d26a8693e3bed73aa15/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.688137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e09f43a6c745c39aa37e3b49ee8296, user_id=3444676894d54d26a8693e3bed73aa15, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.691167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.825412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 916/1848] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:49 2022] PUT /identity/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296/users/3444676894d54d26a8693e3bed73aa15/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:49.829481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.839670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d3f0e-24cf-4723-af92-67874234f953 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.895181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.895775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.896054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.896325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.897051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.898673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf291-ac15-480c-98a3-4acebd25ded8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.908508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 933/1849] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:49.912385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:49.922916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a8e8-2be4-49b1-ae75-4620c102f71e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:49.927811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:49.931509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.931509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.931509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] PATH_INFO: `/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296/users/3444676894d54d26a8693e3bed73aa15/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.931864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e09f43a6c745c39aa37e3b49ee8296, user_id=3444676894d54d26a8693e3bed73aa15, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:49.934568 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:49.944741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 917/1850] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:49 2022] PUT /identity/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296/users/3444676894d54d26a8693e3bed73aa15/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:49.956086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:49.956656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:49.956936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:49.983956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] MFA Rules not processed for user `3444676894d54d26a8693e3bed73aa15`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:49.985207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:50.058523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 934/1851] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:50.069478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:50.071187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:50.129968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124641d-a69a-4d71-a9fe-d901d5d48973 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:50.134617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:50.135207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:50.135490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:50.136202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:50.149442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:50.151468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0c6c6-1dfe-4448-9f72-af4151c9761b service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:50.161729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 918/1852] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:51.548434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:51.611311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471728a-eded-4ced-aa93-44cfa09676a0 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:51.616290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:51.617269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:51.617560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:51.617831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] PATH_INFO: `/v3/users/b3f13c6657a44ceeb8231a2fb2f5d600` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:51.619685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f13c6657a44ceeb8231a2fb2f5d600)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:51.621996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:51.919293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f13c6657a44ceeb8231a2fb2f5d600'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:51.928107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f13c6657a44ceeb8231a2fb2f5d600'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:51.928603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f13c6657a44ceeb8231a2fb2f5d600'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:52.036563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f13c6657a44ceeb8231a2fb2f5d600'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:52.037882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f13c6657a44ceeb8231a2fb2f5d600'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:52.060355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 935/1853] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:51 2022] DELETE /identity/v3/users/b3f13c6657a44ceeb8231a2fb2f5d600 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:52.065116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:52.065631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:52.065708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:52.092486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:52.093591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:52.175011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 919/1854] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:52.184179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:52.185913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:52.243063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3380-cb13-4ec4-82d2-03e488bdafa9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:52.247456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:52.248100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:52.248404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:52.248672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:52.257588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:52.259152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:52.269397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 936/1855] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:52.765764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:52.767403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:52.781101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b1dbd-95b1-43ef-b06e-05167abb7db1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:52.807245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:52.809688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:52.810148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:52.810484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] PATH_INFO: `/v3/projects/5a302bb22aae4829bc5e2b2302be893f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:52.812231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a302bb22aae4829bc5e2b2302be893f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:52.814383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:52.954103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a302bb22aae4829bc5e2b2302be893f', 'request_id': 'req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:52.959698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a302bb22aae4829bc5e2b2302be893f', 'request_id': 'req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.064446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a302bb22aae4829bc5e2b2302be893f', 'request_id': 'req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.078393 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] The token cache is being invalidate because project 5a302bb22aae4829bc5e2b2302be893f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:53.078997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.079512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.081584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 920/1856] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:52 2022] DELETE /identity/v3/projects/5a302bb22aae4829bc5e2b2302be893f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:53.086761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:53.105423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a4a-c9a8-49f4-9a62-bc0cedd2c698 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:53.164731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:53.166142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:53.166414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:53.166679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] PATH_INFO: `/v3/users/3444676894d54d26a8693e3bed73aa15` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:53.167847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3444676894d54d26a8693e3bed73aa15)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:53.169757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:53.381355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3444676894d54d26a8693e3bed73aa15'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.388316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3444676894d54d26a8693e3bed73aa15'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.389013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3444676894d54d26a8693e3bed73aa15'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.471221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3444676894d54d26a8693e3bed73aa15'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.471851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a9f2ee33-9aea-4184-9a9e-b9ebc4bad1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3444676894d54d26a8693e3bed73aa15'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:53.490938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 937/1857] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:53 2022] DELETE /identity/v3/users/3444676894d54d26a8693e3bed73aa15 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:54.068353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:54.070746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:54.092476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f826f-dcbb-49ce-bfb0-ea25f9f3a950 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:54.224941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:54.225825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.235307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.235796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] PATH_INFO: `/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.237326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e09f43a6c745c39aa37e3b49ee8296)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:54.239479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:54.431834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e09f43a6c745c39aa37e3b49ee8296', 'request_id': 'req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:54.438909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e09f43a6c745c39aa37e3b49ee8296', 'request_id': 'req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:54.525406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e09f43a6c745c39aa37e3b49ee8296', 'request_id': 'req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:54.538479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] The token cache is being invalidate because project f0e09f43a6c745c39aa37e3b49ee8296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:54.538767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:54.539411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1efb83b2-4b7d-41e3-828c-c25264ac4a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:54.541610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 921/1858] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:54 2022] DELETE /identity/v3/projects/f0e09f43a6c745c39aa37e3b49ee8296 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:54.546461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c727f-3304-4718-8ca8-beec83486752 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.546865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c727f-3304-4718-8ca8-beec83486752 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.546935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c727f-3304-4718-8ca8-beec83486752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.565721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-819c727f-3304-4718-8ca8-beec83486752 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:54.566986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-819c727f-3304-4718-8ca8-beec83486752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:54.631148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 938/1859] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:54.639002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.639291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.639567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.658116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:54.659372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:54.671474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 922/1860] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:54.672467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c727f-3304-4718-8ca8-beec83486752 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:54.682856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c727f-3304-4718-8ca8-beec83486752 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:54.687731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:54.688386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.688664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.688931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.689775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:54.690198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:54.691781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:54.704141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 939/1861] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:54:54.708972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:54.718397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850d2e4-5116-4da6-9ddd-be10c986d4ef None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:54.723503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:54.724426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.724426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.724750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.725544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:54.729288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:54.903318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 923/1862] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:54 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:54.907503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:54.920116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9434e-be78-490e-bda3-e6ed8a847b3c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:54.992526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:54.993924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:54.994298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:54.994637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:54.995446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:54.997490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.132687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 940/1863] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:54 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:55.134711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:55.147734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e208-82e4-4efb-a1c1-5103076de537 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:55.152820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:55.153485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.153818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.154139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.154883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:55.158124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.168886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 924/1864] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:55.173167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:55.186618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc5c6-7a54-40fa-b3aa-b67d0b18188f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:55.191690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:55.192362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.192744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.192929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.193623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:55.198081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc360b-cee0-4832-9412-18738f4a18c3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.214058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 941/1865] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:55.223387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:55.241980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ca4d-3674-4baf-9ede-e3e72143f1c3 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:55.248936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:55.250057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.250449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.251029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] PATH_INFO: `/v3/projects/4e3fe3bbb93b4c7893ef81b5ff0d6f24/users/51f1d8f1dc4c4bd4aebca0d9aeb99a2d/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.278744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3fe3bbb93b4c7893ef81b5ff0d6f24, user_id=51f1d8f1dc4c4bd4aebca0d9aeb99a2d, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:55.281819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.362232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 925/1866] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:55 2022] PUT /identity/v3/projects/4e3fe3bbb93b4c7893ef81b5ff0d6f24/users/51f1d8f1dc4c4bd4aebca0d9aeb99a2d/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:55.381369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.381626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.381918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.418804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] MFA Rules not processed for user `51f1d8f1dc4c4bd4aebca0d9aeb99a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:55.420140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:55.502452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 942/1867] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:55.504925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:55.583334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda012-da35-4497-91d7-1bc35856623f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:55.589632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:55.592398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.594599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.594599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.594599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:55.596633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.732284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 926/1868] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:55 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:54:55.733461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:55.744613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f98d-05c2-4f67-bebf-43d955fadf86 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:55.817719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:55.818439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:55.818876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:55.819156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:55.819898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:55.822468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:55.996562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 943/1869] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:55 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:56.001398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.037273 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800e58-136d-426a-b281-f506d3dcf3e1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.054316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.055737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.059058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.059522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.061275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.064768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.084950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 927/1870] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:56.088913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.103380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8958391-5264-43f3-a135-fe63efe13825 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.110326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.111302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.111676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.112020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] PATH_INFO: `/v3/projects/d6a822113a8f43a88b26734a3d430d71/users/f20b4b0c27604645befb4508045a936e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.129187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a822113a8f43a88b26734a3d430d71, user_id=f20b4b0c27604645befb4508045a936e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.132154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.280372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 944/1871] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:56 2022] PUT /identity/v3/projects/d6a822113a8f43a88b26734a3d430d71/users/f20b4b0c27604645befb4508045a936e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:56.284657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.295188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08c57-21e7-47c6-9fe1-635859cdec4a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.401421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.401421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.401421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.401421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.401769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.402744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daca21-ee75-477d-ac7f-bde057dc493a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.414144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 928/1872] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:54:56.418688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.436819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf228-578e-472b-b48f-42516452f5cc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.443125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.445018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.445304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.446363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] PATH_INFO: `/v3/projects/d6a822113a8f43a88b26734a3d430d71/users/f20b4b0c27604645befb4508045a936e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.448531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a822113a8f43a88b26734a3d430d71, user_id=f20b4b0c27604645befb4508045a936e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.451330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.467076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 945/1873] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:56 2022] PUT /identity/v3/projects/d6a822113a8f43a88b26734a3d430d71/users/f20b4b0c27604645befb4508045a936e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:56.477357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.477720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.479182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.507693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] MFA Rules not processed for user `f20b4b0c27604645befb4508045a936e`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:56.509535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:56.584737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 929/1874] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:56.597589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.600373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:56.677079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adbd16-bb77-4db7-9b99-0d4a0d284279 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.682540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.683404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.683756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.684383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.698216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.701464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.710905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 946/1875] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:56.874342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:56.885120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491611-8385-4de8-b4eb-8d443e7281b5 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:56.888736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:56.889384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:56.889668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:56.889969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:56.957333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:56.959442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f912bc-0bb3-44ff-aaef-cae9f6f76add service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:56.978511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 930/1876] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:54:57.017796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:57.019351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:57.095098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd8a0-1e1d-4937-9783-d4baac309ac5 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:57.112972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:57.113916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:57.114458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:57.114809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] PATH_INFO: `/v3/users/203d7d72d0e64520af319b63f816f0e7` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:57.116271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=203d7d72d0e64520af319b63f816f0e7)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:57.118953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:57.398423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203d7d72d0e64520af319b63f816f0e7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:57.405669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203d7d72d0e64520af319b63f816f0e7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:57.406373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203d7d72d0e64520af319b63f816f0e7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:57.531720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203d7d72d0e64520af319b63f816f0e7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:57.532593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203d7d72d0e64520af319b63f816f0e7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:57.572567 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 947/1877] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:57 2022] DELETE /identity/v3/users/203d7d72d0e64520af319b63f816f0e7 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:57.580748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:57.581929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:57.582373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:57.625223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:57.638980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:57.755841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 931/1878] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:57.765986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:57.767894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:57.887311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94fa0e-5b5c-4b94-be0f-c05bdefa23f3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:57.893535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:57.897982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:57.897982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:57.897982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:57.907850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:57.909487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b4da8-9653-4ce4-ad15-fe89a11fd8bf service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:57.920963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 948/1879] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:58.013183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:58.014689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:58.027584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90fcd1-cc85-4c49-b115-707c9309acfe None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:58.032892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:58.033767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:58.034399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:58.034699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] PATH_INFO: `/v3/users/51f1d8f1dc4c4bd4aebca0d9aeb99a2d` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:58.035885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f1d8f1dc4c4bd4aebca0d9aeb99a2d)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:58.037954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:58.320991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f1d8f1dc4c4bd4aebca0d9aeb99a2d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.332567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f1d8f1dc4c4bd4aebca0d9aeb99a2d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.333469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f1d8f1dc4c4bd4aebca0d9aeb99a2d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.334184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f1d8f1dc4c4bd4aebca0d9aeb99a2d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.436817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f1d8f1dc4c4bd4aebca0d9aeb99a2d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.460598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 932/1880] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:58 2022] DELETE /identity/v3/users/51f1d8f1dc4c4bd4aebca0d9aeb99a2d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:54:58.465684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:58.466249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:58.466249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:58.490824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:58.492548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:58.557823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:58.559710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:58.574337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 949/1881] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:58.575255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e997a8-5783-47c2-9d07-c32ea37216c5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:58.580300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:58.581290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:58.582128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:58.582441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] PATH_INFO: `/v3/projects/683c9d04e6c944958a832b4b225ae935` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:58.583963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=683c9d04e6c944958a832b4b225ae935)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:58.584073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:58.585446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:58.586322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:58.654530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03de30-f159-4fbc-82b6-25a3de8b84f2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:58.658134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:58.658785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:58.659060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:58.659347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:58.668952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:58.670410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791dfc-10a0-4caa-b281-5abaf2ab71ab service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:58.679743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 950/1882] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:54:58.744053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683c9d04e6c944958a832b4b225ae935', 'request_id': 'req-23b01a38-2254-4c99-820f-78b8b7dde1aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.750374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683c9d04e6c944958a832b4b225ae935', 'request_id': 'req-23b01a38-2254-4c99-820f-78b8b7dde1aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.904765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683c9d04e6c944958a832b4b225ae935', 'request_id': 'req-23b01a38-2254-4c99-820f-78b8b7dde1aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.926578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] The token cache is being invalidate because project 683c9d04e6c944958a832b4b225ae935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:58.927248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.928355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-23b01a38-2254-4c99-820f-78b8b7dde1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:58.931756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 933/1883] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:58 2022] DELETE /identity/v3/projects/683c9d04e6c944958a832b4b225ae935 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:58.938433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:58.938979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:58.939520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:58.970202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:58.971365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:59.064613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 951/1884] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:54:59.074525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.074815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.075090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.111803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:59.113051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:59.121583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 934/1885] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:59.125870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.137571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c49ea-c47c-497b-bb36-546f51d8a379 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.142337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.143199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.143475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.143742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.144489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:54:59.144789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.146404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.163773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 952/1886] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:54:59.170794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.182922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc9fe9-07c7-46ed-992c-9fcfd18f3a60 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.193168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.193168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.193168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.193168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.193471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.193834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.317811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 935/1887] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:59 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:59.320210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.332844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebee14-cc15-486d-a20d-55c57dad5a6d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.361262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.363573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:59.424351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.425169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.431192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.431192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.431192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.431192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.470413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a8d2-b241-4caf-abca-43b688096954 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.475710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.476569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.476848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.477123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] PATH_INFO: `/v3/projects/4e3fe3bbb93b4c7893ef81b5ff0d6f24` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.478895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3fe3bbb93b4c7893ef81b5ff0d6f24)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.480801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.579980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 953/1888] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:54:59 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:54:59.581189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.591995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11d3b-6827-403b-b1c2-243eb9e66d0d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.596828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.597487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.597854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.598167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.598953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.600575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.617903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 954/1889] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:59.621851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.635482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e276d-a1d0-40cf-a7f9-d4582ba401e9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.649411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3fe3bbb93b4c7893ef81b5ff0d6f24', 'request_id': 'req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:59.662816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3fe3bbb93b4c7893ef81b5ff0d6f24', 'request_id': 'req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:59.702193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.702867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.703155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.703431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.704171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.705775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.716616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 955/1890] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:54:59.720685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.730193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b85a87-3ea9-47bd-bd48-813c57866ede admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.734980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.735859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.736178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.736424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] PATH_INFO: `/v3/projects/f9da3b42299c46159b6c037c03fef054/users/da1e12bb90114303b09732c5f98d5339/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.744434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3fe3bbb93b4c7893ef81b5ff0d6f24', 'request_id': 'req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:59.752161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9da3b42299c46159b6c037c03fef054, user_id=da1e12bb90114303b09732c5f98d5339, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.755815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afdac8-86e1-4a31-9143-ca47c2da6bcc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.756918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] The token cache is being invalidate because project 4e3fe3bbb93b4c7893ef81b5ff0d6f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:54:59.757207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:59.757853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:54:59.760189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 936/1891] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:54:59 2022] DELETE /identity/v3/projects/4e3fe3bbb93b4c7893ef81b5ff0d6f24 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:59.764270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:54:59.765600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:59.778955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0765-5c99-4bc0-ae5c-65632e48bb6c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:54:59.783777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:54:59.784664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.784916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.788192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] PATH_INFO: `/v3/users/f20b4b0c27604645befb4508045a936e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.788192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20b4b0c27604645befb4508045a936e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:54:59.788386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:54:59.881779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 956/1892] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:54:59 2022] PUT /identity/v3/projects/f9da3b42299c46159b6c037c03fef054/users/da1e12bb90114303b09732c5f98d5339/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:54:59.893584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:54:59.893875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:54:59.894209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:54:59.922870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] MFA Rules not processed for user `da1e12bb90114303b09732c5f98d5339`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:54:59.924255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:54:59.994590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 957/1893] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:54:59.998633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:00.000074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:00.064954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4391c7f-75b7-4677-be48-7f8780f20f18 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:00.069684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:00.070369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:00.070647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:00.070917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:00.071660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:00.073547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:00.169920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20b4b0c27604645befb4508045a936e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:00.177205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20b4b0c27604645befb4508045a936e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:00.177900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20b4b0c27604645befb4508045a936e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:00.178525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20b4b0c27604645befb4508045a936e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:00.265587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20b4b0c27604645befb4508045a936e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:00.292892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 958/1894] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:54:59 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:00.294188 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:00.296270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:00.306260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 937/1895] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:54:59 2022] DELETE /identity/v3/users/f20b4b0c27604645befb4508045a936e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:00.380763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5884717-6ae9-4893-a51d-90573267fb11 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:00.437330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:00.437936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:00.438252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:00.438528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:00.439213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:00.441168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:00.666638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 959/1896] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:00 2022] POST /identity/v3/users => generated 289 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:00.671024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:00.683669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36face-3e76-4b2f-a2f3-e77f2ce226a8 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:00.690409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:00.691284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:00.691713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:00.692724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:00.693692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:00.696892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:00.711315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 938/1897] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:00.716032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:00.726280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1288-cfb0-4629-b33f-0082b1623a37 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:00.737038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:00.738448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:00.738734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:00.739007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:00.739809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:00.741948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:00.807132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 960/1898] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:00.807237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:00.807237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdaed-4aa1-44e7-993a-cd3407d5791c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:00.807237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:00.807237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:00.807673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:00.807673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] PATH_INFO: `/v3/projects/ed073307a455406ca787ddf6b513aad9/users/41d9c7b9867b443a8c30dbdf93e03626/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:00.807673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed073307a455406ca787ddf6b513aad9, user_id=41d9c7b9867b443a8c30dbdf93e03626, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:00.807673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52cefa-2ed3-4300-88ec-312856559724 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.277123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 939/1899] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:00 2022] PUT /identity/v3/projects/ed073307a455406ca787ddf6b513aad9/users/41d9c7b9867b443a8c30dbdf93e03626/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:01.295014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.295014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:01.304557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.305047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.305539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.308487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca729-704d-49ec-b8d7-0e958754b150 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.358866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] MFA Rules not processed for user `41d9c7b9867b443a8c30dbdf93e03626`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:01.360321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:01.430973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.431861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.432143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.432417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] PATH_INFO: `/v3/projects/d6a822113a8f43a88b26734a3d430d71` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.434529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a822113a8f43a88b26734a3d430d71)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.437485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.487106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 940/1900] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:01.491459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.504519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7620e-9048-4894-8e0b-00864d68c094 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.511289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.512019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.512296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.512902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.513253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.515235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.582247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a822113a8f43a88b26734a3d430d71', 'request_id': 'req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:01.587773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a822113a8f43a88b26734a3d430d71', 'request_id': 'req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:01.644466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 941/1901] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:01.648659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.670312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a822113a8f43a88b26734a3d430d71', 'request_id': 'req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:01.687362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] The token cache is being invalidate because project d6a822113a8f43a88b26734a3d430d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:01.688006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:01.689341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c03fbd06-02fc-48e8-92c2-a3c7729d6f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:01.691595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 961/1902] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:01 2022] DELETE /identity/v3/projects/d6a822113a8f43a88b26734a3d430d71 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:01.699030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44441-05e2-41cc-b0e3-3b7a875400df None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.699555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44441-05e2-41cc-b0e3-3b7a875400df None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.700065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44441-05e2-41cc-b0e3-3b7a875400df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.723908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7da44441-05e2-41cc-b0e3-3b7a875400df None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:01.725653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7da44441-05e2-41cc-b0e3-3b7a875400df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:01.731684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094483-1466-4764-9986-a03a013d2c54 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.736154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 962/1903] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:01.743978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.744259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.744792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.744972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.745201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.745521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.745627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.746356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.748363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.769849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:01.771400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:01.781339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 963/1904] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:01.793148 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.814558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b152e50-d6f5-4c6e-bfba-dcb8a06692b5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.821882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.823577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.824118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.824964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.825847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:01.826329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.828547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.847837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 964/1905] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:01.849192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.868935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b1f2-8559-424e-9796-5511f2d39c27 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.882857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.883761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.884048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.884322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.885203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.887010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.897792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 942/1906] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:01.908062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.910231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:01.929840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16031779-2a45-4e20-9702-010e7a80feb0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.936687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.937871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.938358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.938780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.939764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:01.941658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:01.955051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 943/1907] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:01.958828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:01.972884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82a5-c32f-486c-ad6c-678d3f51aed5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:01.978832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:01.979889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:01.980305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:01.980739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] PATH_INFO: `/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc/users/5e9e454186c749c5b2d92402c5fdf800/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:01.998991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9757d8228a35497abf4ffe6eeacfe8bc, user_id=5e9e454186c749c5b2d92402c5fdf800, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.002043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.072233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 965/1908] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:02.076439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.184352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 944/1909] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:01 2022] PUT /identity/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc/users/5e9e454186c749c5b2d92402c5fdf800/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:02.188312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb47031-fbb9-47fd-a7dd-903aa0ef8abf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.188461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.261082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5bc5-a287-43ac-a8c8-d4d7eb4157ce admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.266516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.267242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.267394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.267529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.267787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.268467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.268596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.269006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.269613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.270188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.271352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.273498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.282358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 945/1910] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:02.287188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.298073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938987-874c-465e-9a7e-c63d1b3f29fa admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.302948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.303843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.304121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.304396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] PATH_INFO: `/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc/users/5e9e454186c749c5b2d92402c5fdf800/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.306596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9757d8228a35497abf4ffe6eeacfe8bc, user_id=5e9e454186c749c5b2d92402c5fdf800, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.309417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bdf72-56d5-44d2-93cb-f260467738d8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.324154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 946/1911] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:02 2022] PUT /identity/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc/users/5e9e454186c749c5b2d92402c5fdf800/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:02.335495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.335782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.336061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.368750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] MFA Rules not processed for user `5e9e454186c749c5b2d92402c5fdf800`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:02.369951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:02.377360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 966/1912] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:02 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:02.379039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.389487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e667d-444b-40d9-98e4-1703cc59ca5d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.457924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.458297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.458585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.458855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.459602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.463168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.468574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 947/1913] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:02.478552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 967/1914] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:02.483237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.497296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d543247-5d47-4a38-9ae2-80bfb494754f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.502086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.502756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.503061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.503330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.504052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.505646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd9e18-b46a-418f-a811-7be77664b90c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.515879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 948/1915] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:02.520471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.531324 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f3990-7f5e-4e42-8ca8-421ed4dfdda6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:02.536096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:02.537119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.537419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.537778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] PATH_INFO: `/v3/projects/3f1575239a604e7cb9d32e73a6a53505/users/d8d4be46e33d46bc970614b0ef9febcd/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.552999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1575239a604e7cb9d32e73a6a53505, user_id=d8d4be46e33d46bc970614b0ef9febcd, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:02.555824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:02.670924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 968/1916] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:02 2022] PUT /identity/v3/projects/3f1575239a604e7cb9d32e73a6a53505/users/d8d4be46e33d46bc970614b0ef9febcd/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:02.682089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:02.682378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:02.682688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:02.713324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] MFA Rules not processed for user `d8d4be46e33d46bc970614b0ef9febcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:02.714776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:02.782397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 949/1917] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:02.991136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:02.993397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:03.000703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:03.002203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:03.052043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a6da-8b76-4103-bea4-8194bd3a6dab admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:03.056179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:03.056830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:03.057110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:03.057381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:03.059232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:03.060365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb5f6-8518-4af2-9308-ef60e7e6e7d2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:03.064058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:03.064768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:03.065115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:03.065397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:03.074498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:03.075933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:03.085919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 950/1918] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:03.107688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:03.141965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:03.144042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351f9d5-4644-4ae0-98e5-ceac587f1265 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:03.155760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 969/1919] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:03.191049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484edfe-fe92-44ba-9b0c-2865c5a9973d service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:03.196676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:03.197448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:03.197866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:03.198274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] PATH_INFO: `/v3/users/d8d4be46e33d46bc970614b0ef9febcd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:03.203185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d4be46e33d46bc970614b0ef9febcd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:03.206844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:03.427903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d4be46e33d46bc970614b0ef9febcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:03.436003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d4be46e33d46bc970614b0ef9febcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:03.436818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d4be46e33d46bc970614b0ef9febcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:03.437449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d4be46e33d46bc970614b0ef9febcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:03.547692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d4be46e33d46bc970614b0ef9febcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:03.567035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 951/1920] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:03 2022] DELETE /identity/v3/users/d8d4be46e33d46bc970614b0ef9febcd => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:03.571521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:03.571808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:03.572092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:03.589452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:03.590665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:03.649017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 970/1921] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:03.658748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:03.660547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:03.717512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bdd83-3001-4af2-a3e6-c7338607b6a5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:03.721159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:03.721801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:03.722112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:03.722388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:03.731822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:03.733252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4e83c-58f8-4a4c-8755-5d72c9f6d1a5 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:03.743158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 952/1922] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:04.258274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:04.263579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:04.272065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3108e8-dac1-4da4-bad3-24f47af40c1d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:04.284749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:04.284749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.284749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.284749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] PATH_INFO: `/v3/projects/3f1575239a604e7cb9d32e73a6a53505` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.290580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1575239a604e7cb9d32e73a6a53505)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:04.290580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:04.395009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1575239a604e7cb9d32e73a6a53505', 'request_id': 'req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:04.400253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1575239a604e7cb9d32e73a6a53505', 'request_id': 'req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:04.484157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1575239a604e7cb9d32e73a6a53505', 'request_id': 'req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:04.496091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] The token cache is being invalidate because project 3f1575239a604e7cb9d32e73a6a53505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:04.496315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:04.496943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9eb317d6-599d-4fd7-aeb9-be8d23df23cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:04.498696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 971/1923] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:04 2022] DELETE /identity/v3/projects/3f1575239a604e7cb9d32e73a6a53505 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:04.503686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.504156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.504245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.521088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:04.522321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:04.578735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 953/1924] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:04.587382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.587666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.587939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.606932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:04.608193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:04.616650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 972/1925] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:04.621156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:04.632248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921df30-2ad7-43b3-8c70-0a7dbd9ccbed None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:04.639241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:04.641058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.641058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.641058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.641405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:04.641405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:04.643031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:04.655943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 954/1926] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:04.660621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:04.673844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532980-1e02-417d-8707-a1444c6f5b11 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:04.678861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:04.679499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.679777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.680045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.680728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:04.682674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:04.796472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 973/1927] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:04 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:04.800666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:04.810994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcce98-220f-40f7-871e-8d20e28dffe2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:04.866327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:04.866984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:04.867260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:04.867526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:04.868789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:04.870706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.001656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 955/1928] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:04 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:05.005754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:05.018203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefed0-adff-4887-8d6d-12a379aa603a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:05.023023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:05.023688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.023970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.024242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.024970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:05.026601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.037301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 974/1929] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:05.042348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:05.053007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80651-e827-4557-a3a0-2c8ee9d2551e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:05.058271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:05.058983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.059246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.063167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.063167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:05.063167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d609-ba2f-49b4-b48b-cf6201213479 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.075459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 956/1930] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:05.076591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:05.086979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadf92-7db4-4c44-ade1-5152b2e71ed3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:05.091539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:05.092409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.092691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.092957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] PATH_INFO: `/v3/projects/4b49557be96b40c5ae193bbeb8140266/users/ea6da75aa6cf4645af4187eda4783853/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.110405 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b49557be96b40c5ae193bbeb8140266, user_id=ea6da75aa6cf4645af4187eda4783853, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:05.113275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.251474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 975/1931] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:05 2022] PUT /identity/v3/projects/4b49557be96b40c5ae193bbeb8140266/users/ea6da75aa6cf4645af4187eda4783853/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:05.261708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.262074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.262364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.289515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] MFA Rules not processed for user `ea6da75aa6cf4645af4187eda4783853`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:05.291390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:05.356491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 957/1932] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:05.367139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:05.368899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:05.425512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4752-f45a-4f2e-8b7c-52d1336bd2f1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:05.429284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:05.429943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.430251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.430524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.438528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:05.440001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51745f-febd-42e3-8500-7045314ef565 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.448699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 976/1933] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:05.473660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:05.533052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773cd8d-2bfe-4c7e-8cc5-4db305d1c4cd None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:05.537706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:05.538667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.538941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.539386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] PATH_INFO: `/v3/users/ea6da75aa6cf4645af4187eda4783853` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:05.541227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6da75aa6cf4645af4187eda4783853)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:05.543191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:05.842931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6da75aa6cf4645af4187eda4783853'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:05.849823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6da75aa6cf4645af4187eda4783853'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:05.850519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6da75aa6cf4645af4187eda4783853'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:05.851174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6da75aa6cf4645af4187eda4783853'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:05.961074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6da75aa6cf4645af4187eda4783853'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:05.982402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 958/1934] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:05 2022] DELETE /identity/v3/users/ea6da75aa6cf4645af4187eda4783853 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:05.986926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:05.987200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:05.987475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:06.005092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:06.012415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:06.064277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 977/1935] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:06.074149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:06.075536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:06.134768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f6f30-59fc-4f98-bab7-1aa6fd74907b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:06.138378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:06.139021 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:06.139302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:06.139577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:06.150767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:06.152260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41045b4c-b032-46f8-9766-8591826b3f75 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:06.162160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 959/1936] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:06.732668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:06.734128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:06.746825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e37c1c-9cb1-40d4-b5b2-1bef50d5164d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:06.752278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:06.753260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:06.753544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:06.753853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] PATH_INFO: `/v3/projects/4b49557be96b40c5ae193bbeb8140266` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:06.755067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b49557be96b40c5ae193bbeb8140266)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:06.757092 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:06.876731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b49557be96b40c5ae193bbeb8140266', 'request_id': 'req-837afba8-b2d9-4a90-9752-ed842d3a6295'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:06.884409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b49557be96b40c5ae193bbeb8140266', 'request_id': 'req-837afba8-b2d9-4a90-9752-ed842d3a6295'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:06.984473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b49557be96b40c5ae193bbeb8140266', 'request_id': 'req-837afba8-b2d9-4a90-9752-ed842d3a6295'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:06.997009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] The token cache is being invalidate because project 4b49557be96b40c5ae193bbeb8140266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:06.997293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:06.997932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-837afba8-b2d9-4a90-9752-ed842d3a6295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:06.999528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 978/1937] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:06 2022] DELETE /identity/v3/projects/4b49557be96b40c5ae193bbeb8140266 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:07.004715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.005222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.005314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.026373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:07.027644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:07.087034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 960/1938] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:07.096659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.096934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.097490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.118878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:07.120078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:07.129807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 979/1939] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:07.133737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.144099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c181aa9-99c5-4986-ac87-1f4917fb1d50 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.149199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.149859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.150182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.150456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.151183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:07.151486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.153069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.166506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 961/1940] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:07.170735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.180055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0fde7-cadb-4c7a-ada2-a0b2c45eaa30 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.185533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.186217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.186497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.186768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.187452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.189359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.311952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 980/1941] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:07.316316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.326229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c028-cd60-4bf8-ad7d-21f20d0915bb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.380903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.381564 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.381844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.382152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.382885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.384838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.487235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 962/1942] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:07.491876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.502507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81d78-3e32-4cd3-9e48-2ad358b0a79f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.507479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.508158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.508442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.508714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.509471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.511090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.521896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 981/1943] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:07.527424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.538777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592222cf-cb62-492c-95d3-fc568d25fa5f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.544558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.545228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.545506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.545775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.546576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.548192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cdb62-b9cb-440a-92c7-074da97bba22 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.560377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 963/1944] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:07.567641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.578953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d4c2-0201-4b30-9b84-44d4ca823b71 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.584181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.585131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.585594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.585727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] PATH_INFO: `/v3/projects/acc1e7a0a5e945768e1ac6bbec460443/users/3cc02710d6bf44ebbe36bec6089cdb02/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.603351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc1e7a0a5e945768e1ac6bbec460443, user_id=3cc02710d6bf44ebbe36bec6089cdb02, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.606218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.721551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 982/1945] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:07 2022] PUT /identity/v3/projects/acc1e7a0a5e945768e1ac6bbec460443/users/3cc02710d6bf44ebbe36bec6089cdb02/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:07.732652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.732951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.733216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.762110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] MFA Rules not processed for user `3cc02710d6bf44ebbe36bec6089cdb02`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:07.763237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:07.826098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 964/1946] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:07.830687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:07.890639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65333-8b39-4634-a052-ee83770b3d74 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:07.895582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:07.896241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:07.896553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:07.896823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:07.897513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:07.899455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:07.997757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 983/1947] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:07 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:08.002065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.012705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf7d7d-3c5e-436d-8e19-bf76294a2a11 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.067835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.068567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.068845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.069116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.069808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.071759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.157875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 965/1948] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:08 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:08.161885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.173098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a424ca-e105-43c4-9faa-9f7428d92a86 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.177876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.178636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.179743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.180739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.182421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.184013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.196235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 984/1949] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:08.202288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.213228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4f3c0-b524-46bf-8689-82b1cf59255f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.218384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.219477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.219701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.220059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] PATH_INFO: `/v3/projects/55bb3964c7634d9f8d5f90889117f026/users/aac562e52dec445fba38104534a6114e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.238687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bb3964c7634d9f8d5f90889117f026, user_id=aac562e52dec445fba38104534a6114e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.241581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.327533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 966/1950] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:08 2022] PUT /identity/v3/projects/55bb3964c7634d9f8d5f90889117f026/users/aac562e52dec445fba38104534a6114e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:08.331769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.342268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309ac1-c0e3-475e-beda-290450dcf54f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.397026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.397699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.397979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.398286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.399009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.401105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a0b5e-7f55-4947-9d99-d147370b16b8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.410497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 985/1951] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:08.414710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.425387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5222b1-233b-468b-ba17-dbb4435f0b59 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.429959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.430858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.431135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.431405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] PATH_INFO: `/v3/projects/55bb3964c7634d9f8d5f90889117f026/users/aac562e52dec445fba38104534a6114e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.433345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bb3964c7634d9f8d5f90889117f026, user_id=aac562e52dec445fba38104534a6114e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.436000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.445678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 967/1952] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:08 2022] PUT /identity/v3/projects/55bb3964c7634d9f8d5f90889117f026/users/aac562e52dec445fba38104534a6114e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:08.455588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.455871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.456143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.482459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] MFA Rules not processed for user `aac562e52dec445fba38104534a6114e`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:08.483641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:08.548631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 986/1953] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:08.559154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:08.560826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:08.621707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95391eb-52c3-44ff-b09b-aa07537a343f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:08.625284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:08.625917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:08.626230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:08.626500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:08.682747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:08.684189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:08.693118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 968/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:10.982614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:10.984106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:10.996230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8635661-adf0-45b5-af53-c3b8dd84a004 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:10.999764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:11.000617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:11.000894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:11.001162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:11.002890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:11.061243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:11.062717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dee766-9dd4-4f98-aef6-e9af78e34b0f service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:11.071502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 987/1955] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:12.085312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:12.176872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb7e1-31bd-469d-9ec3-62c563dfcbd7 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:12.181630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:12.182559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:12.182843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:12.183105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] PATH_INFO: `/v3/users/3cc02710d6bf44ebbe36bec6089cdb02` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:12.185005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc02710d6bf44ebbe36bec6089cdb02)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:12.186957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:12.470785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc02710d6bf44ebbe36bec6089cdb02'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:12.477469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc02710d6bf44ebbe36bec6089cdb02'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:12.478164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc02710d6bf44ebbe36bec6089cdb02'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:12.478774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc02710d6bf44ebbe36bec6089cdb02'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:12.612969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc02710d6bf44ebbe36bec6089cdb02'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:12.631186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 969/1956] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:12 2022] DELETE /identity/v3/users/3cc02710d6bf44ebbe36bec6089cdb02 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:12.636347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:12.636807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:12.636917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:12.658614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:12.659812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:12.720593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 988/1957] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:12.730713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:12.732143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:12.792184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c15b-43d2-4084-a273-497253f9d5a1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:12.795818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:12.796462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:12.796737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:12.797006 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:12.805669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:12.807671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:12.817296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 970/1958] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:13.053340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:13.054868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:13.114385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8aeaa-cbf1-49cf-9bb6-308a339d99b5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:13.118079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:13.118726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:13.119008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:13.119280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:13.121626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:13.195250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:13.196775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:13.207425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 989/1959] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:13.237794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:13.239308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:13.255630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b944d-32f7-4172-bfe9-789588069272 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:13.260862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:13.262560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:13.262846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:13.263462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] PATH_INFO: `/v3/projects/acc1e7a0a5e945768e1ac6bbec460443` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:13.264840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc1e7a0a5e945768e1ac6bbec460443)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:13.267198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:13.408100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc1e7a0a5e945768e1ac6bbec460443', 'request_id': 'req-b4013c6d-2361-452d-97c3-b23167ddc9b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.413380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc1e7a0a5e945768e1ac6bbec460443', 'request_id': 'req-b4013c6d-2361-452d-97c3-b23167ddc9b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.484343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc1e7a0a5e945768e1ac6bbec460443', 'request_id': 'req-b4013c6d-2361-452d-97c3-b23167ddc9b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.496334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] The token cache is being invalidate because project acc1e7a0a5e945768e1ac6bbec460443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:13.496643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.497272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.498995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 971/1960] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:13 2022] DELETE /identity/v3/projects/acc1e7a0a5e945768e1ac6bbec460443 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:13.508084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:13.518449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ee1a-4718-4646-ab17-c3f57b4ef896 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:13.587100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:13.587100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:13.587100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:13.587100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] PATH_INFO: `/v3/users/aac562e52dec445fba38104534a6114e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:13.587794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac562e52dec445fba38104534a6114e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:13.589829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:13.859609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac562e52dec445fba38104534a6114e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.866940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac562e52dec445fba38104534a6114e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:13.867736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac562e52dec445fba38104534a6114e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:14.127034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac562e52dec445fba38104534a6114e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:14.127742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5e13defa-94c4-41fd-92f4-3f86455d7e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac562e52dec445fba38104534a6114e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:14.147880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 990/1961] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:13 2022] DELETE /identity/v3/users/aac562e52dec445fba38104534a6114e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:14.631390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:14.633108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:14.646740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013c6d-2361-452d-97c3-b23167ddc9b8 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:14.715451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:14.725246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:14.725246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:14.725246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] PATH_INFO: `/v3/projects/55bb3964c7634d9f8d5f90889117f026` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:14.725246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bb3964c7634d9f8d5f90889117f026)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:14.725246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:14.872399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bb3964c7634d9f8d5f90889117f026', 'request_id': 'req-c90f41eb-31e6-4f84-9a83-f3080199e671'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:14.878408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bb3964c7634d9f8d5f90889117f026', 'request_id': 'req-c90f41eb-31e6-4f84-9a83-f3080199e671'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:14.990453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bb3964c7634d9f8d5f90889117f026', 'request_id': 'req-c90f41eb-31e6-4f84-9a83-f3080199e671'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:15.009385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] The token cache is being invalidate because project 55bb3964c7634d9f8d5f90889117f026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:15.010002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:15.011120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c90f41eb-31e6-4f84-9a83-f3080199e671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:15.018930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 972/1962] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:14 2022] DELETE /identity/v3/projects/55bb3964c7634d9f8d5f90889117f026 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:15.020509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.020967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.021053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.044479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:15.046237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:15.113461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 991/1963] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:15.122473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.126930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.126930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.144036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:15.145358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:15.155188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 973/1964] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:15.159580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.170525 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27996b17-e70b-4261-9ad7-ef5bd3c77335 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.176728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.177957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.178436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.178712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.179447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:15.179752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.181366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.194792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 992/1965] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:15.199411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.208747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351e6ca-83aa-4dc0-89ae-5ddccd226b23 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.214562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.215149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.215423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.215686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.216362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.218309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.370043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 974/1966] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:15 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:15.373095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.382847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7048-7a07-4d28-afcf-e41f319f29b9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.450444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.450444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.450444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.450444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.450788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.450788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.605928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 993/1967] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:15 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:15.607138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.617549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bd34d-a490-4ac8-8891-d54398a88d0b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.630876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.631649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.632200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.632456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.633335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.639291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.646321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 975/1968] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:15.650436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.660698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83817a-bc77-42be-98d3-4fecbcbbe84a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.665941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.667661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.667661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.667976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.668897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.670570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4cee8-6496-4b68-9992-836a92d983de admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.680967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 994/1969] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:15.685935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.695822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ad38-daa2-4c6f-96c7-d9b199bc2c42 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.702005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.703646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.703927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.704197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] PATH_INFO: `/v3/projects/a4ec75326b484292937db17eccee43f3/users/df7b5849a9214c41ab39669aa1b62eac/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.721201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ec75326b484292937db17eccee43f3, user_id=df7b5849a9214c41ab39669aa1b62eac, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.723866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.800646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 976/1970] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:15 2022] PUT /identity/v3/projects/a4ec75326b484292937db17eccee43f3/users/df7b5849a9214c41ab39669aa1b62eac/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:15.804396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.804678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.805213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.829555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:15.829555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:15.886325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 995/1971] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:15.898786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:15.901849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:15.961604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723308e-0992-48cb-8a88-5e9e848330cd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:15.965922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:15.966597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:15.966928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:15.967198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:15.976830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:15.978290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:15.989469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 977/1972] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:17.946479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:17.949028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:17.966700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0c14-2de1-480f-9e88-a763a33ad8c2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:18.004426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:18.005326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:18.006736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:18.007009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] PATH_INFO: `/v3/users/5691356782af47a29af6e39dee37e325` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:18.008934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5691356782af47a29af6e39dee37e325)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:18.013283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:18.021471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:18.024150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:18.052973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e746-c545-4444-9487-d6b0d30da54f service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:18.061207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:18.062687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:18.063016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:18.063454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] PATH_INFO: `/v3/users/71eeb62bfa994693b663cae7c267f47f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:18.065139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71eeb62bfa994693b663cae7c267f47f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:18.067254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:18.239432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5691356782af47a29af6e39dee37e325'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.246313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5691356782af47a29af6e39dee37e325'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.246986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5691356782af47a29af6e39dee37e325'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.300203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71eeb62bfa994693b663cae7c267f47f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.307599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71eeb62bfa994693b663cae7c267f47f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.308287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71eeb62bfa994693b663cae7c267f47f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.308892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71eeb62bfa994693b663cae7c267f47f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.344383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5691356782af47a29af6e39dee37e325'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.345006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6b44a9ce-dbe2-47d2-894b-323bec09b4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5691356782af47a29af6e39dee37e325'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.363890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 996/1973] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:17 2022] DELETE /identity/v3/users/5691356782af47a29af6e39dee37e325 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:18.441883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71eeb62bfa994693b663cae7c267f47f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.483263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:18.483520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 978/1974] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:18 2022] DELETE /identity/v3/users/71eeb62bfa994693b663cae7c267f47f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:18.483843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:18.484221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:18.517155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:18.518782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:18.615830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 997/1975] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:18.625629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:18.627059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:18.688274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464b61-11f2-4b75-b5ec-3b1c12a784b2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:18.691822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:18.692467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:18.692741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:18.693075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:18.702854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:18.704272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:18.714095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 979/1976] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:18.729186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:18.730852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:18.752593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3c775-80d6-4760-a5c8-8d5a110d69ab None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:18.762225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:18.764776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:18.765127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:18.765466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] PATH_INFO: `/v3/projects/5d1c49ed681a48558eb679ed290b8c39` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:18.767858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1c49ed681a48558eb679ed290b8c39)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:18.772363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:18.965871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1c49ed681a48558eb679ed290b8c39', 'request_id': 'req-9c415d18-f943-4758-b560-fc172ce71a60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:18.971371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1c49ed681a48558eb679ed290b8c39', 'request_id': 'req-9c415d18-f943-4758-b560-fc172ce71a60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.095254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1c49ed681a48558eb679ed290b8c39', 'request_id': 'req-9c415d18-f943-4758-b560-fc172ce71a60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.140537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] The token cache is being invalidate because project 5d1c49ed681a48558eb679ed290b8c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:19.140831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.141551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.145806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 998/1977] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:18 2022] DELETE /identity/v3/projects/5d1c49ed681a48558eb679ed290b8c39 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:19.148285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:19.160261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefad0-04ac-4c14-84a7-9e3225352a9f service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:19.177267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:19.178748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:19.263499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:19.264856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:19.265319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:19.265762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] PATH_INFO: `/v3/users/d724cd35cfd1410bb828ed4c976e45f6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:19.267401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d724cd35cfd1410bb828ed4c976e45f6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:19.269762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:19.333381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c415d18-f943-4758-b560-fc172ce71a60 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:19.338905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:19.339822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:19.340151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:19.340447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] PATH_INFO: `/v3/users/da1e12bb90114303b09732c5f98d5339` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:19.341680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1e12bb90114303b09732c5f98d5339)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:19.343645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:19.505150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd724cd35cfd1410bb828ed4c976e45f6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.516034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd724cd35cfd1410bb828ed4c976e45f6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.517436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd724cd35cfd1410bb828ed4c976e45f6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.518103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd724cd35cfd1410bb828ed4c976e45f6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.589216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1e12bb90114303b09732c5f98d5339'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.598389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1e12bb90114303b09732c5f98d5339'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.599221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1e12bb90114303b09732c5f98d5339'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.607154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-06c136b1-8f35-4c48-9cba-f5ccbd695b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd724cd35cfd1410bb828ed4c976e45f6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.643321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 980/1978] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:19 2022] DELETE /identity/v3/users/d724cd35cfd1410bb828ed4c976e45f6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:19.711571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1e12bb90114303b09732c5f98d5339'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.713386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1e12bb90114303b09732c5f98d5339'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:19.743892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:19.744180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:19.744488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:19.750383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 999/1979] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:19 2022] DELETE /identity/v3/users/da1e12bb90114303b09732c5f98d5339 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:19.767487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:19.768739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:19.787996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:19.789847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:19.863543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 981/1980] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:19.874417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:19.876082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:19.926803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dc4b7-6e55-4a54-8572-d287c528029b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:19.941827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:19.942987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:19.943272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:19.943547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] PATH_INFO: `/v3/projects/80ae875b007f4c2d8fb195ace6dd8a3b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:19.948179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ae875b007f4c2d8fb195ace6dd8a3b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:19.950791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:19.958309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c95d49-f486-49b7-aed5-b51adc2b1eec None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:19.966976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:19.967426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:19.967757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:19.968037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:19.985313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:19.988806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:20.000035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 982/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:20.125859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ae875b007f4c2d8fb195ace6dd8a3b', 'request_id': 'req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.132320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ae875b007f4c2d8fb195ace6dd8a3b', 'request_id': 'req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.308184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ae875b007f4c2d8fb195ace6dd8a3b', 'request_id': 'req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.324517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] The token cache is being invalidate because project 80ae875b007f4c2d8fb195ace6dd8a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:20.325249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.326159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.328246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1000/1982] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:19 2022] DELETE /identity/v3/projects/80ae875b007f4c2d8fb195ace6dd8a3b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:20.332334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:20.349397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f378a-9859-43ec-83c2-140922ca3bbc service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:20.400781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:20.403079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:20.452964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:20.454263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:20.455172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:20.455645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] PATH_INFO: `/v3/users/76586bd3b0984124bf0c5953a6880f47` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:20.457820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76586bd3b0984124bf0c5953a6880f47)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:20.460922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:20.580176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4c11-ec1e-4d64-8d42-dd873e7643d1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:20.586443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:20.587340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:20.587620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:20.587926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] PATH_INFO: `/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:20.589785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a4f727b2ad4c0a829c93a7ea14aa05)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:20.592696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:20.729381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76586bd3b0984124bf0c5953a6880f47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.736707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76586bd3b0984124bf0c5953a6880f47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.737405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76586bd3b0984124bf0c5953a6880f47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.738035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76586bd3b0984124bf0c5953a6880f47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.796352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a4f727b2ad4c0a829c93a7ea14aa05', 'request_id': 'req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.814254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a4f727b2ad4c0a829c93a7ea14aa05', 'request_id': 'req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.834766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76586bd3b0984124bf0c5953a6880f47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.871873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 983/1983] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:20 2022] DELETE /identity/v3/users/76586bd3b0984124bf0c5953a6880f47 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:20.873616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:20.877601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:20.953431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a4f727b2ad4c0a829c93a7ea14aa05', 'request_id': 'req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.967436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed47e-d4f1-48c4-85c5-9267c2b2a65c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:20.971014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] The token cache is being invalidate because project f7a4f727b2ad4c0a829c93a7ea14aa05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:20.973120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.975213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:20.980053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1001/1984] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:20 2022] DELETE /identity/v3/projects/f7a4f727b2ad4c0a829c93a7ea14aa05 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:20.981051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:20.983671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:20.984856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:20.985888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:20.986372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] PATH_INFO: `/v3/users/4fc6b5e9c3ef4b6799795116f8e81b51` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:20.987816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:20.989817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc6b5e9c3ef4b6799795116f8e81b51)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:20.992849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:21.119933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc762d-2fa7-4b65-a504-5bee94c1d9a5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:21.125868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:21.126848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:21.127302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:21.127576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] PATH_INFO: `/v3/projects/f9da3b42299c46159b6c037c03fef054` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:21.128782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9da3b42299c46159b6c037c03fef054)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:21.130759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:21.352426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9da3b42299c46159b6c037c03fef054', 'request_id': 'req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.355977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc6b5e9c3ef4b6799795116f8e81b51'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.370601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9da3b42299c46159b6c037c03fef054', 'request_id': 'req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.380660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc6b5e9c3ef4b6799795116f8e81b51'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.383617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc6b5e9c3ef4b6799795116f8e81b51'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.386329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc6b5e9c3ef4b6799795116f8e81b51'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.502560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9da3b42299c46159b6c037c03fef054', 'request_id': 'req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.516519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] The token cache is being invalidate because project f9da3b42299c46159b6c037c03fef054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:21.516798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.517477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-6d2fcc61-5bb3-4898-a3b9-c7775fe785f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.519327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1002/1985] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:20 2022] DELETE /identity/v3/projects/f9da3b42299c46159b6c037c03fef054 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:21.520432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:21.520726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:21.521003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:21.540552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:21.541815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:21.586986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc6b5e9c3ef4b6799795116f8e81b51'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:21.610166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 984/1986] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:20 2022] DELETE /identity/v3/users/4fc6b5e9c3ef4b6799795116f8e81b51 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:21.610166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:21.610166 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:21.617073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1003/1987] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:21.618261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:21.619610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:21.640787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb000-cfe1-40a7-ace9-b079e7bcdbf3 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:21.754125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:21.754849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:21.755137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:21.755414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] PATH_INFO: `/v3/users/41d9c7b9867b443a8c30dbdf93e03626` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:21.757054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8372ae-98cc-42dc-a96e-c10e1d46b0fc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:21.757750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d9c7b9867b443a8c30dbdf93e03626)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:21.760025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:21.765474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:21.767986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:21.769743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:21.770542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] PATH_INFO: `/v3/projects/6636b56f101547018a76345609369cb2` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:21.774410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6636b56f101547018a76345609369cb2)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:21.779716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.127389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6636b56f101547018a76345609369cb2', 'request_id': 'req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.131296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d9c7b9867b443a8c30dbdf93e03626'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.140570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d9c7b9867b443a8c30dbdf93e03626'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.141588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d9c7b9867b443a8c30dbdf93e03626'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.143603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6636b56f101547018a76345609369cb2', 'request_id': 'req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.219328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d9c7b9867b443a8c30dbdf93e03626'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.220527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd07cb8f-1916-4fbc-94e7-42ea965bee79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d9c7b9867b443a8c30dbdf93e03626'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.247229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1004/1988] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:21 2022] DELETE /identity/v3/users/41d9c7b9867b443a8c30dbdf93e03626 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:22.249113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdb0-ebbf-46df-a452-cf8a3ab13c9d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.260432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdb0-ebbf-46df-a452-cf8a3ab13c9d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.263228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdb0-ebbf-46df-a452-cf8a3ab13c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.291884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8d0cfdb0-ebbf-46df-a452-cf8a3ab13c9d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:22.293527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8d0cfdb0-ebbf-46df-a452-cf8a3ab13c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.307091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6636b56f101547018a76345609369cb2', 'request_id': 'req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.327369 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] The token cache is being invalidate because project 6636b56f101547018a76345609369cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:22.328022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.329255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.331199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 985/1989] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:21 2022] DELETE /identity/v3/projects/6636b56f101547018a76345609369cb2 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:22.332439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.336002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.398698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1005/1990] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:22.402929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.404005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.404005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.422233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba96a-fdc0-4aac-aa08-6ba8eb36e085 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:22.431426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:22.433629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.434117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.434544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] PATH_INFO: `/v3/projects/eb57f4c97b6a4f46ad3f1c129569ba8f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.436675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb57f4c97b6a4f46ad3f1c129569ba8f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:22.440447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:22.441070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.441828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.451549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1006/1991] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:22.452775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.469144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853eca0-8a3f-4e21-ac05-2887f0cef3cc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:22.475633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:22.476565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.477421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.477985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.480303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:22.480806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:22.482768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebefd0-61f4-4db2-842d-e2ddaa8a39f8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.496577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1007/1992] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:22.501553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.501553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.501553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.547232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:22.548487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.567144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1008/1993] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:22.568010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.587098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cabd73-ff70-426f-b44e-0477b7532bcf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:22.606701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'request_id': 'req-26ba6f32-893e-4a1f-8742-0a2832532150'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.623145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'request_id': 'req-26ba6f32-893e-4a1f-8742-0a2832532150'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.690285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:22.692145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.692496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.692831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.693660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:22.696129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb7722-3cf3-4289-bc2e-bf1a0c8ab8f1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.711080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'request_id': 'req-26ba6f32-893e-4a1f-8742-0a2832532150'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.731462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] The token cache is being invalidate because project eb57f4c97b6a4f46ad3f1c129569ba8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:22.732468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.733649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:22.736019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 986/1994] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:22 2022] DELETE /identity/v3/projects/eb57f4c97b6a4f46ad3f1c129569ba8f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:22.736999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.738607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.755103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba6f32-893e-4a1f-8742-0a2832532150 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:22.760244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:22.761000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.761351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.761716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.762574 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:22.762884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:22.764487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e10e-8c26-4425-b07b-14f5060599af admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.777139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 987/1995] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:22.778590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.778882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.779179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.800548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:22.801775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.809827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 988/1996] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:22.810717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.821531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9babe3-37da-4e75-bc31-91ede4614844 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:22.827059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:22.827829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.828476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.828877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.829573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:22.832009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:22.840210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1009/1997] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:22.843990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:22.844448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:22.844872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:22.875789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:22.876923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.929817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 989/1998] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:22.929817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:22.932240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:22.997926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1010/1999] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:23.002243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.004463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.020412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c167-6c7c-4249-80e3-96d61d51b2d2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.025792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b1ddc-050b-4b74-8ea8-2303f9558b99 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.026199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.027227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.027507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.027777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] PATH_INFO: `/v3/projects/ed073307a455406ca787ddf6b513aad9` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.028963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed073307a455406ca787ddf6b513aad9)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.031033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.032778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.033661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.033945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.034264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.048851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.053094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.182878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed073307a455406ca787ddf6b513aad9', 'request_id': 'req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.183654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 990/2000] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:22 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:23.184541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.192650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed073307a455406ca787ddf6b513aad9', 'request_id': 'req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.201395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d9e2-13e1-42c6-be71-6a77e7d968ec admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.276362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.277153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.277940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.278267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.278981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.282340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.293420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed073307a455406ca787ddf6b513aad9', 'request_id': 'req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.308960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] The token cache is being invalidate because project ed073307a455406ca787ddf6b513aad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:23.309183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.309871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.311808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1011/2001] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:22 2022] DELETE /identity/v3/projects/ed073307a455406ca787ddf6b513aad9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:23.312720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.314128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.328146 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3dad-24bc-4be9-8cf0-f3d8984d2854 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.333444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.334244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.334533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.334832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.335556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:23.335928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.337556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.349892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1012/2002] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:23.350941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.352661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.370183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302338-3cbf-40cf-9e89-20753d9a2133 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.376852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.377543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.377825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.378162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.378898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.380550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6831c5-1cd8-40c3-991f-e3ee52903cda admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.384632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 991/2003] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:23 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:23.386422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.390098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.395446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1013/2004] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:23.397316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.397611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.397891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.403940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c412-96c1-4a7b-8ef8-7e6757fb5fdf admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.409470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.410397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.410665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.411112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] PATH_INFO: `/v3/users/5e9e454186c749c5b2d92402c5fdf800` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.412333 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9e454186c749c5b2d92402c5fdf800)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.414432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.425268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] MFA Rules not processed for user `df7b5849a9214c41ab39669aa1b62eac`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:23.426535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.494739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1014/2005] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:23.495748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.507214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81cb70-c9f7-4174-b251-3f32834628c1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.512521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.513192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.513470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.513750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.514462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.516398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.614714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9e454186c749c5b2d92402c5fdf800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.621984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9e454186c749c5b2d92402c5fdf800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.622732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9e454186c749c5b2d92402c5fdf800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.623346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9e454186c749c5b2d92402c5fdf800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.636675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1015/2006] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:23 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:23.637811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.639698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.700064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705365-58f7-43d5-bbe8-e4405854f215 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.703651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9e454186c749c5b2d92402c5fdf800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:23.704801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.705466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.705745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.706040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.707032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.708636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.719013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1016/2007] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:23.719963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.721717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.727053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 992/2008] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:23 2022] DELETE /identity/v3/users/5e9e454186c749c5b2d92402c5fdf800 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:23.728081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.730092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.735126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36b190-44aa-4233-b502-098afe455813 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.797248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.798569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.799038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.799449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.800944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.803254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.804754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba655312-f23b-41dd-847e-094c0208f960 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.811422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.812152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.812436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.812707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.813402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.815740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.818037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1017/2009] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:23.832480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.832480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:23.837478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d313-b46b-40e5-8fcc-16ae79d46e84 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.842332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.842993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.843268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.843537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.844218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.846145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:23.926679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 993/2010] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:23 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:23.926679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:23.985132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138ff4-fd7a-4198-83ef-85d22d86dc1d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:23.989855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:23.990551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:23.990833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:23.991106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:23.991829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:23.993438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.004042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 994/2011] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:24.004868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.016938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7f5e8-3b1c-4e54-aff2-49383c938de0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.021735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.022857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.022981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.023253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] PATH_INFO: `/v3/projects/8a5070a60df4426580433c69ed69b37a/users/73d00e35e98e424598499a6305c19cc8/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.040767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5070a60df4426580433c69ed69b37a, user_id=73d00e35e98e424598499a6305c19cc8, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.044300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.064150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1018/2012] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:23 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:24.065415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.082421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d652-2049-433c-a436-498e89ad3f9b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.094176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.094176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.094176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.094176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.094498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.099314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.125580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 995/2013] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:24 2022] PUT /identity/v3/projects/8a5070a60df4426580433c69ed69b37a/users/73d00e35e98e424598499a6305c19cc8/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:24.126326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.183800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1019/2014] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:24 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:24.184745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.206234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea978cd2-decc-4b73-89ff-a68cc48b2193 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.213641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497c44-cc37-4dd4-b4b5-4314488aa265 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.216070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.217046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.217362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.217643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] PATH_INFO: `/v3/projects/2aac8b6f4af14fc1bcba0fbb6ff1edb0/users/a34258e15548496ab15bff7b7603b21e/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.220758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.221439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.224308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.224420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.225179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.226839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1e5d-586d-42b9-8b68-b894ed9ecb09 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.234655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aac8b6f4af14fc1bcba0fbb6ff1edb0, user_id=a34258e15548496ab15bff7b7603b21e, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.238281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1020/2015] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:24.239346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.239609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.239891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.240166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.268160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] MFA Rules not processed for user `73d00e35e98e424598499a6305c19cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:24.269728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:24.337641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 996/2016] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:24 2022] PUT /identity/v3/projects/2aac8b6f4af14fc1bcba0fbb6ff1edb0/users/a34258e15548496ab15bff7b7603b21e/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:24.338566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.345920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1021/2017] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:24.357344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.358658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9216a9-46ef-48ba-b102-a0f9111299a5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.408032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfe5e-57b5-4771-9b60-cc6534117eda admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.414192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.419355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.419355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.419355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.419355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.419355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.431315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 997/2018] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:24.434403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.434501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.434501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.434501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.434770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:24.434856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.436227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.438211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.448110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce846d-4e49-4bf5-a5e5-f06773793370 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1022/2019] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:24.452818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.461908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.462886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.463328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.463754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] PATH_INFO: `/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.465189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9757d8228a35497abf4ffe6eeacfe8bc)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.466334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5e11-e15b-4795-9a3f-f39f10365083 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.472085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.472840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.473175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.473550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.474358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.476067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.478884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647cf51-aef3-4da0-b315-d5eb56f24a86 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.627015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1023/2020] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:24 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:24.631485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.631775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.632334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.641122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9757d8228a35497abf4ffe6eeacfe8bc', 'request_id': 'req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:24.647827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9757d8228a35497abf4ffe6eeacfe8bc', 'request_id': 'req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:24.667371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] MFA Rules not processed for user `a34258e15548496ab15bff7b7603b21e`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:24.668627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:24.734821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1024/2021] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:24.734821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.735131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9757d8228a35497abf4ffe6eeacfe8bc', 'request_id': 'req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:24.747021 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] The token cache is being invalidate because project 9757d8228a35497abf4ffe6eeacfe8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:24.747448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:24.748216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:24.749914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 998/2022] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:24 2022] DELETE /identity/v3/projects/9757d8228a35497abf4ffe6eeacfe8bc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:24.756419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:24.757978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:24.804280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473196-69e3-4149-b6cf-362f4daf6953 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.809484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.810541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.810920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.811292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] PATH_INFO: `/v3/projects/0fce70215948486f9a622fa8273cab28/users/141f64d16ff545ceb06efbdb99e858e9/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.834959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fce70215948486f9a622fa8273cab28, user_id=141f64d16ff545ceb06efbdb99e858e9, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.836202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3118-1fa3-4f5a-aa50-4d6402d9954b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:24.838680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:24.841852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:24.842791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:24.843198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:24.843483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] PATH_INFO: `/v3/projects/0054a05e1c0b4300addba50adfb442ef/users/b10632cbf11b46b2b94afd5df59daa25/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:24.865590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0054a05e1c0b4300addba50adfb442ef, user_id=b10632cbf11b46b2b94afd5df59daa25, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:24.868535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.010198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1025/2023] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:24 2022] PUT /identity/v3/projects/0fce70215948486f9a622fa8273cab28/users/141f64d16ff545ceb06efbdb99e858e9/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:25.010198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.011822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.073091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 999/2024] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:24 2022] PUT /identity/v3/projects/0054a05e1c0b4300addba50adfb442ef/users/b10632cbf11b46b2b94afd5df59daa25/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:25.073091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.075730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.084801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379fcd3-98c2-4bff-874e-fdac2ca28431 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.154448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128442-5833-4a88-ab2b-91a0077e3b42 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.160178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.161131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.161640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.163074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.163789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.164313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.165830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.166363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.166649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.166922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.167617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.169591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd1ae-cfc3-4186-b934-5bf1c59746b5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.308278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1026/2025] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:25.309400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1000/2026] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:25.309894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f6a2-7ff6-4152-a9cd-4b786b0b79cc None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.310226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f6a2-7ff6-4152-a9cd-4b786b0b79cc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.310505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f6a2-7ff6-4152-a9cd-4b786b0b79cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.310854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.313837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.328864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8616f6a2-7ff6-4152-a9cd-4b786b0b79cc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:25.330046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8616f6a2-7ff6-4152-a9cd-4b786b0b79cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.379310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983322d-4e02-4a7a-ba49-cc6a65f68fdc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.384355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.385550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.385827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.386123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.386949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.389590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.401657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1027/2027] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:25.401657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.401657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.401657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.406721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1001/2028] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:25.407024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.420616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79857bf-8872-4231-8d1b-56d5ff6862c0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.425553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:25.426800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.426936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.428390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.428885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.429980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.430500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.432404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbaeba-ec5c-4f12-bdbf-131fca136da5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.437364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1028/2029] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:25.437364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.448775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182419c-1de9-482a-9e72-b8c6fae490b8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.452892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1002/2030] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:25.454626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.454917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.455198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.457598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.458397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.458745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.459085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.460566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.461860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.486314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:25.487584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.499082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1003/2031] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:25.499082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.507980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd23f-efc4-47cd-b946-1c05289f8918 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.516431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.516431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.516431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.516431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] PATH_INFO: `/v3/projects/0fce70215948486f9a622fa8273cab28/users/141f64d16ff545ceb06efbdb99e858e9/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.516786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fce70215948486f9a622fa8273cab28, user_id=141f64d16ff545ceb06efbdb99e858e9, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.519363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.533231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1004/2032] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:25 2022] PUT /identity/v3/projects/0fce70215948486f9a622fa8273cab28/users/141f64d16ff545ceb06efbdb99e858e9/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:25.535045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.537961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:25.569095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1029/2033] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:25.569095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.580240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f298-1726-4146-86d6-dad2b974be73 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.628512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67403a-a13e-4d9a-aa7d-995664e5433a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.633317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.634188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.634867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.635148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.647057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.648577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.648577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.649000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] PATH_INFO: `/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d/users/cfdde4212ba049ac989d393692b2574b/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.664591 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4b302ebb4f42f29cdf57e52fc84b5d, user_id=cfdde4212ba049ac989d393692b2574b, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.668347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.702611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.704769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.716041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1005/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:25.716861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.726500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986816-3cb4-4f62-a7f5-a08b62fcbabc service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.733600 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.734474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.735639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.735934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.737137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:25.737443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.739195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.761295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1006/2035] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:55:25.765129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1030/2036] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:25 2022] PUT /identity/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d/users/cfdde4212ba049ac989d393692b2574b/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:25.765382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.766751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.788651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0cb62-a33a-459f-ac33-2517139d7b8e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.864706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.865772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.866147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.866425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.867163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.869117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.871004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9d05-451c-483a-b327-084659bbecef admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.883762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1007/2037] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:25.885075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.887489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.888273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.888550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.888904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.889656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.892431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.899150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2d46-c954-484a-b5f9-63c488ffbee3 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.906217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.906897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.907178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.907443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.920228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1031/2038] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:25.921465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:25.925794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.930545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:25.948269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6067e8-2680-457c-83af-10cf06ebc411 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:25.960102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:25.961277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:25.962276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:25.963854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] PATH_INFO: `/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241/users/2f954513027644129e6224092dad718f/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:25.994934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1ee1bcb75a474ba4a9a8fcead47241, user_id=2f954513027644129e6224092dad718f, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:25.998808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.065845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1008/2039] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:25 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:26.065845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.107893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1032/2040] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:25 2022] PUT /identity/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241/users/2f954513027644129e6224092dad718f/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:26.108748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.163293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6b90-4023-4b7c-a1fd-cc8b25d6cae2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.232427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f01f-c086-46fb-a5ea-85c37eb2ba58 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.245007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.245390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.245665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.245937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.247127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.249059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7fa1e-daec-4353-bffc-87cd6f3e768c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.292532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.293524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.294395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.294681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] PATH_INFO: `/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d/users/cfdde4212ba049ac989d393692b2574b/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.298507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4b302ebb4f42f29cdf57e52fc84b5d, user_id=cfdde4212ba049ac989d393692b2574b, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.301940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.330876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1009/2041] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:26 2022] PUT /identity/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d/users/cfdde4212ba049ac989d393692b2574b/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:26.332456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.370624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1033/2042] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:26 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:26.370624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.370624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.370624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.408678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] MFA Rules not processed for user `cfdde4212ba049ac989d393692b2574b`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:26.410089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:26.418461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1403-d6e2-47e6-b739-a45abdb2b1f7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.425487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.426144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.426425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.426870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.427610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.429445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.444103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1010/2043] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:26.444103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.463739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482079-54d4-4365-a27a-2a593ea94c06 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.485738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.488229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.488851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.496543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.499337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.501529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.526907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1011/2044] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:26.530268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.559917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1034/2045] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:26.561003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.571464 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c0c88-e273-4dbd-8064-01d4ea2e80d2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.578473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.579379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.579661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.579930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] PATH_INFO: `/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241/users/2f954513027644129e6224092dad718f/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.582770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1ee1bcb75a474ba4a9a8fcead47241, user_id=2f954513027644129e6224092dad718f, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.584834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1fc24-f1e4-4f74-b43f-24cf117956ee None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.607065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.610771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.611521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.611735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.612007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.613043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.618412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.648743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1012/2046] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:26 2022] PUT /identity/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241/users/2f954513027644129e6224092dad718f/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:26.650872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1035/2047] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:26.654646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.663276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:26.666723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:26.666843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eaf61-c091-4806-9a45-499231d794e3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.756949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.757868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.758194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.758454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] PATH_INFO: `/v3/projects/13cfbe72dcc24c108503a3e3b304d435/users/e81a6f59026d403f93ee29de20119da6/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.776247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7d02-6901-4740-9d08-6ed772a36019 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:26.780870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:26.781538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.781814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.782116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.782765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cfbe72dcc24c108503a3e3b304d435, user_id=e81a6f59026d403f93ee29de20119da6, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.785906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:26.786564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150cb9-df5c-48d3-940c-6b89ff970d0d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.874561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:26.875920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eced23b-a3c1-4272-b73f-cb58f340881c service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:26.888806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1013/2048] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:26.890698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:26.891077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:26.891430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:26.923813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] MFA Rules not processed for user `2f954513027644129e6224092dad718f`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:26.925187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:27.002471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1036/2049] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:26 2022] PUT /identity/v3/projects/13cfbe72dcc24c108503a3e3b304d435/users/e81a6f59026d403f93ee29de20119da6/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:27.013510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:27.014099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:27.014186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:27.063238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1014/2050] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:27.074585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:27.077418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] MFA Rules not processed for user `e81a6f59026d403f93ee29de20119da6`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:27.077418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:27.089371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa4c3-9d81-47f5-89cd-41de75865b98 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:27.210932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1037/2051] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:27.215169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:27.215858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:27.216137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:27.216412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:27.218330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:27.299226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:27.300485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:27.311896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1015/2052] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:27.923548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:27.925207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:27.938761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b43dc-968a-485a-a35d-1daf9fe7dfa5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:27.942342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:27.942978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:27.943252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:27.944271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:27.953883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:27.955915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e610d7-75ff-41e3-a64d-5fab8cf3f384 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:27.976797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1038/2053] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:29.376717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:29.378406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:29.504705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ef0ee-16e0-43dd-9d5f-5405a3b5c652 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:29.510225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:29.511164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:29.511471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:29.511870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] PATH_INFO: `/v3/users/01ed031ea91d498082f54afe60f02cf9` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:29.513544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ed031ea91d498082f54afe60f02cf9)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:29.515606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:29.774800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ed031ea91d498082f54afe60f02cf9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:29.782448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ed031ea91d498082f54afe60f02cf9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:29.783168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ed031ea91d498082f54afe60f02cf9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:29.783768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ed031ea91d498082f54afe60f02cf9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:29.878792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e86de054-1981-4781-964c-87afec1748a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ed031ea91d498082f54afe60f02cf9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:29.900663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1016/2054] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:29 2022] DELETE /identity/v3/users/01ed031ea91d498082f54afe60f02cf9 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:29.905167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:29.907335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:29.907335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:29.924959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:29.928867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:30.045587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:30.046087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:30.046536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:30.069216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1039/2055] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:30.073032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] MFA Rules not processed for user `e81a6f59026d403f93ee29de20119da6`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:30.076612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:30.085437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:30.088388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:30.151013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1017/2056] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:30.294608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2988-0030-4600-871a-37ae0b29f0c6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:30.294608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:30.294608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:30.294608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:30.296522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:30.303254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:30.305534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:30.327118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1040/2057] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:31.337277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:31.340546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:31.383469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b83b-b2e4-4728-ba7a-aa3b672127e9 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:31.390659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:31.392065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:31.392545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:31.393026 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] PATH_INFO: `/v3/projects/4995eda5c2a3489bb4331d36590afbee` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:31.394570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4995eda5c2a3489bb4331d36590afbee)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:31.398289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:31.538449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4995eda5c2a3489bb4331d36590afbee', 'request_id': 'req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:31.544999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4995eda5c2a3489bb4331d36590afbee', 'request_id': 'req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:31.639401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4995eda5c2a3489bb4331d36590afbee', 'request_id': 'req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:31.657718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] The token cache is being invalidate because project 4995eda5c2a3489bb4331d36590afbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:31.658103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:31.658816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:31.660424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1018/2058] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:31 2022] DELETE /identity/v3/projects/4995eda5c2a3489bb4331d36590afbee => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:31.664542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:31.675293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6eae-ecba-4174-8a4b-fc8514cac3ea service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:31.764362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:31.765769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:31.766308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:31.766926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] PATH_INFO: `/v3/users/545624806f4841bbbe5aa7365c1e9152` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:31.768412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545624806f4841bbbe5aa7365c1e9152)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:31.770648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:32.033804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545624806f4841bbbe5aa7365c1e9152'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:32.045970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545624806f4841bbbe5aa7365c1e9152'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:32.047673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545624806f4841bbbe5aa7365c1e9152'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:32.244144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545624806f4841bbbe5aa7365c1e9152'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:32.244820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545624806f4841bbbe5aa7365c1e9152'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:32.274288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1041/2059] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:31 2022] DELETE /identity/v3/users/545624806f4841bbbe5aa7365c1e9152 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:33.183835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:33.183835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:33.282695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630ed9-3bbb-4fe3-a880-c4905f8d0d8b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:33.372195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:33.373787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:33.374109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:33.374391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:33.381337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:33.538337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:33.539826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fa9be-7793-41fb-bdce-bd66aff95fa4 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:33.569221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1019/2060] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:34.187619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:34.189252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:34.384134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef502abd-5274-4eb8-be77-3687327d00c5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:34.402243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:34.403380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:34.403852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:34.404317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] PATH_INFO: `/v3/projects/838144148e7b4b4698a974c08dd35ca1` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:34.408024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838144148e7b4b4698a974c08dd35ca1)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:34.412758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:34.698179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838144148e7b4b4698a974c08dd35ca1', 'request_id': 'req-8c8853e2-81c1-4346-bf0c-d2f321523dc9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:34.715638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838144148e7b4b4698a974c08dd35ca1', 'request_id': 'req-8c8853e2-81c1-4346-bf0c-d2f321523dc9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:34.795742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838144148e7b4b4698a974c08dd35ca1', 'request_id': 'req-8c8853e2-81c1-4346-bf0c-d2f321523dc9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:34.820014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] The token cache is being invalidate because project 838144148e7b4b4698a974c08dd35ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:34.824254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:34.825722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8c8853e2-81c1-4346-bf0c-d2f321523dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:34.841057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1042/2061] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:34 2022] DELETE /identity/v3/projects/838144148e7b4b4698a974c08dd35ca1 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:34.845636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8468d-da0f-43fc-90ba-90f44a2737ac None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:34.846795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8468d-da0f-43fc-90ba-90f44a2737ac None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:34.847250 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8468d-da0f-43fc-90ba-90f44a2737ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:34.897983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-35d8468d-da0f-43fc-90ba-90f44a2737ac None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:34.899245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-35d8468d-da0f-43fc-90ba-90f44a2737ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:35.059036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1020/2062] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:35.066621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.067170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.067433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.097401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:35.098970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:35.117773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.126581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.127010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.132008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1043/2063] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:35.138005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.155076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556f3bd-59e2-41af-89d1-1b62c126f787 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.160979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.161895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.162417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.181753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.182756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:35.183067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.185318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.205676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] MFA Rules not processed for user `141f64d16ff545ceb06efbdb99e858e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:35.207958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1044/2064] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:55:35.212143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:35.219668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.235809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a53e-8a45-445f-9d0d-5901e295c6b4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.250569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.251252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.251532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.253119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.253837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.270298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.387226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1021/2065] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:35.392907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1045/2066] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:35 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:35.397538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.397720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.399587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:35.549833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645c71-ac7c-4828-bbfb-edddf229ab16 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.571340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e0e6-7e32-42bd-bec6-5173e46b428a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.586717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.588924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.589356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.589789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.591744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.595257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.643767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.644442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.644721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.645046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.647191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:35.717672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1046/2067] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:35 2022] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:35.721511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.738075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f638-fbf2-417e-a73f-16ca95c1c4f2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.743042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.743807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.745540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.745540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.745540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.747829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.747959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.749322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.766250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1047/2068] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:35.767407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.772688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1022/2069] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:35.804477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4da7a-50d6-40eb-8573-15809cd35815 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.812098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.812098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.812484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.812826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.813580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.815257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46452f5-ba3b-4bae-ac25-11dce0de0b5f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.832674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1048/2070] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:35.839190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:35.855702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4c80e-d321-42a4-91f0-5b93cd6b4361 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:35.867131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:35.868048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.868456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.868617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] PATH_INFO: `/v3/projects/9b64745240df4bc6bb67d2f3490c3dad/users/7174734e22d649a689e44ecfa392ec09/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:35.892818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b64745240df4bc6bb67d2f3490c3dad, user_id=7174734e22d649a689e44ecfa392ec09, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:35.895687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:35.980249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1023/2071] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:35 2022] PUT /identity/v3/projects/9b64745240df4bc6bb67d2f3490c3dad/users/7174734e22d649a689e44ecfa392ec09/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:35.997511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:35.997511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:35.997511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.052171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] MFA Rules not processed for user `7174734e22d649a689e44ecfa392ec09`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:36.063036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:36.171065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1049/2072] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:36.174552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:36.263772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394159f9-379f-4146-8831-d5f6c560dbb6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:36.269074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:36.269740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.270086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.270381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.271072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:36.272994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:36.379039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1024/2073] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:36 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:36.383141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:36.400924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c91ee0-8638-479c-a509-9998022fcc8c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:36.527956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:36.528984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.529415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.529844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.530737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:36.533823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:36.628990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1050/2074] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:36 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:36.632773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:36.644592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ad5e-c498-4b85-9c28-0868d556b304 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:36.649326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:36.650601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.650956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.651266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.652014 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:36.653664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa160116-41ba-47a0-83f0-a27ffdaa6e65 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:36.669716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:36.674417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1025/2075] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:36.684859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7028-51a8-476e-9bdc-f9bc151707e5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:36.690754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:36.691660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.692210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.692493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] PATH_INFO: `/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb/users/b5d726129b944917b740478282ece1fe/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.734854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc4737626941f6bbf7b9d2cd4279eb, user_id=b5d726129b944917b740478282ece1fe, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:36.737744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:36.755201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272ef7-f3fb-4802-ac8d-7702af62138a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.755201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272ef7-f3fb-4802-ac8d-7702af62138a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.755201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272ef7-f3fb-4802-ac8d-7702af62138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.799044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8a272ef7-f3fb-4802-ac8d-7702af62138a None None] MFA Rules not processed for user `b10632cbf11b46b2b94afd5df59daa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:36.799044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8a272ef7-f3fb-4802-ac8d-7702af62138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:36.882007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1051/2076] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:36 2022] PUT /identity/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb/users/b5d726129b944917b740478282ece1fe/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:36.883852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1026/2077] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:36.895952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:36.896435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:36.896882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:36.898201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:36.955734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] MFA Rules not processed for user `b10632cbf11b46b2b94afd5df59daa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:36.955734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:37.038561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52dfc-f3ee-43c5-a9f9-3d3957c5f495 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:37.056828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:37.057835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.058255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.059980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.061034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:37.064952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:37.091878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1052/2078] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:37.096912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:37.107750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd26207-5607-4da6-a17b-a0116ae668ed admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:37.117952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:37.119463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.119742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.120067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] PATH_INFO: `/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb/users/b5d726129b944917b740478282ece1fe/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.122175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc4737626941f6bbf7b9d2cd4279eb, user_id=b5d726129b944917b740478282ece1fe, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:37.124998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819600d-5c28-4c47-9538-a19241978c5c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:37.152006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1053/2079] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:37 2022] PUT /identity/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb/users/b5d726129b944917b740478282ece1fe/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:37.153716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2fde-115d-4364-b003-e25388820eaf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.153983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2fde-115d-4364-b003-e25388820eaf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.160481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2fde-115d-4364-b003-e25388820eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.166963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1027/2080] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:37.180049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:37.205909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-65be2fde-115d-4364-b003-e25388820eaf None None] MFA Rules not processed for user `b5d726129b944917b740478282ece1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:37.207657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-65be2fde-115d-4364-b003-e25388820eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:37.291174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1242b2-0055-44c7-88ef-ba7089babd3d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:37.336708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1054/2081] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:37.348940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2fde-115d-4364-b003-e25388820eaf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:37.351100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-65be2fde-115d-4364-b003-e25388820eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:37.372311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:37.373300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.373522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.373856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.427802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2fde-115d-4364-b003-e25388820eaf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:37.433455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:37.434608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.434987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.435352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.447961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:37.449871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:37.459419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:37.461047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298320b1-957f-4446-99a6-79675a6fae74 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:37.464827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1055/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:37.506993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1028/2083] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:37.753710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:37.760910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a45326-f982-49b0-bf2d-8b59788cee02 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:37.766819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:37.767553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:37.767691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:37.767943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:37.836667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:37.838154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:37.869889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1056/2084] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:38.549699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155f4a-dc6e-4a68-a635-0a4ae92d7edd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:38.550315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155f4a-dc6e-4a68-a635-0a4ae92d7edd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:38.550315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155f4a-dc6e-4a68-a635-0a4ae92d7edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:38.580412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-37155f4a-dc6e-4a68-a635-0a4ae92d7edd None None] MFA Rules not processed for user `b10632cbf11b46b2b94afd5df59daa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:38.581952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-37155f4a-dc6e-4a68-a635-0a4ae92d7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:38.593134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1029/2085] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:39.276948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:39.291761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87fe39-22f3-4e1c-bf3b-ccfe16c9453c service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:39.297645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:39.304924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:39.304924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:39.304924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:39.304924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:39.508138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:39.515664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:39.572177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1057/2086] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:41.203481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad07-d7f9-49cf-90bd-a69332d005fd None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:41.203923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad07-d7f9-49cf-90bd-a69332d005fd None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:41.204111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad07-d7f9-49cf-90bd-a69332d005fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:41.244194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b625ad07-d7f9-49cf-90bd-a69332d005fd None None] MFA Rules not processed for user `df7b5849a9214c41ab39669aa1b62eac`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:41.245670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b625ad07-d7f9-49cf-90bd-a69332d005fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:41.339669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1030/2087] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:55.155605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:55.157379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:55.237265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096750-55f8-4db7-a590-758287d3fbfc service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:55.242263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:55.243137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:55.243416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:55.243707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] PATH_INFO: `/v3/users/73d00e35e98e424598499a6305c19cc8` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:55.244927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d00e35e98e424598499a6305c19cc8)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:55.246890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:55.432548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d00e35e98e424598499a6305c19cc8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:55.439413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d00e35e98e424598499a6305c19cc8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:55.440088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d00e35e98e424598499a6305c19cc8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:55.503490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d00e35e98e424598499a6305c19cc8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:55.504074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d00e35e98e424598499a6305c19cc8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:55.522522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1058/2088] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:55 2022] DELETE /identity/v3/users/73d00e35e98e424598499a6305c19cc8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:55.527880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:55.528380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:55.528582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:55.551561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:55.553030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:55.613979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1031/2089] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:55.625203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:55.626866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:55.700372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654dc1c-725e-4e55-8d88-5b2e83d9710e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:55.704437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:55.705094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:55.705490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:55.705781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:55.716078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:55.717502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:55.728684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1059/2090] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:55:55.853371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:55.855107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:55.867825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cd267-3a48-43b1-b008-de53176e61fc None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:55.873490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:55.883901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:55.883901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:55.883901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] PATH_INFO: `/v3/users/7174734e22d649a689e44ecfa392ec09` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:55.883901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7174734e22d649a689e44ecfa392ec09)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:55.883901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:56.173308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7174734e22d649a689e44ecfa392ec09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.184107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7174734e22d649a689e44ecfa392ec09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.185088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7174734e22d649a689e44ecfa392ec09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.185926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7174734e22d649a689e44ecfa392ec09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.285248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:56.286994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:56.295951 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-cd4d3dfc-7bad-4164-96c6-20b8450f1237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7174734e22d649a689e44ecfa392ec09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.343828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1032/2091] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:55 2022] DELETE /identity/v3/users/7174734e22d649a689e44ecfa392ec09 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:56.345695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:56.346329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:56.346329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:56.370078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:56.372151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:56.372557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54554-5495-4198-a6b6-4acef0fcb56c service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:56.455579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1033/2092] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:56.466283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:56.467852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:56.468462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:56.469456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:56.469835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:56.470346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] PATH_INFO: `/v3/projects/8a5070a60df4426580433c69ed69b37a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:56.475787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5070a60df4426580433c69ed69b37a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:56.478811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:56.554874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94125d7-e992-4bdc-89b0-ee61a00d8372 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:56.558710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:56.559360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:56.559636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:56.559907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:56.570328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:56.572103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:56.583871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1034/2093] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:56.702958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5070a60df4426580433c69ed69b37a', 'request_id': 'req-79f71f03-1c97-4b6d-bff9-fba1f36562d4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.714236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5070a60df4426580433c69ed69b37a', 'request_id': 'req-79f71f03-1c97-4b6d-bff9-fba1f36562d4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.855549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5070a60df4426580433c69ed69b37a', 'request_id': 'req-79f71f03-1c97-4b6d-bff9-fba1f36562d4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.870982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] The token cache is being invalidate because project 8a5070a60df4426580433c69ed69b37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:56.871263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.872703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:56.874466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1060/2094] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:56 2022] DELETE /identity/v3/projects/8a5070a60df4426580433c69ed69b37a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:56.878919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:56.883703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:56.908590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bce1f-3d2d-40fb-b760-e89a2c862742 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:56.987980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:56.989320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:56.989474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:56.989788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] PATH_INFO: `/v3/users/cfdde4212ba049ac989d393692b2574b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:56.991238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdde4212ba049ac989d393692b2574b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:56.993681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:57.086481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:57.088888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:57.112247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71f03-1c97-4b6d-bff9-fba1f36562d4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:57.118509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:57.120951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:57.120951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:57.120951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] PATH_INFO: `/v3/projects/9b64745240df4bc6bb67d2f3490c3dad` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:57.121223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b64745240df4bc6bb67d2f3490c3dad)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:57.123252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:57.316542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdde4212ba049ac989d393692b2574b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.324617 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdde4212ba049ac989d393692b2574b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.325384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdde4212ba049ac989d393692b2574b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.326000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdde4212ba049ac989d393692b2574b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.330420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b64745240df4bc6bb67d2f3490c3dad', 'request_id': 'req-c66a88f3-7446-4277-8602-ff8ce15b937b'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.337253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b64745240df4bc6bb67d2f3490c3dad', 'request_id': 'req-c66a88f3-7446-4277-8602-ff8ce15b937b'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.460533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdde4212ba049ac989d393692b2574b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.483095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1035/2095] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:56 2022] DELETE /identity/v3/users/cfdde4212ba049ac989d393692b2574b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:57.524110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b64745240df4bc6bb67d2f3490c3dad', 'request_id': 'req-c66a88f3-7446-4277-8602-ff8ce15b937b'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.539193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] The token cache is being invalidate because project 9b64745240df4bc6bb67d2f3490c3dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:57.539761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.540697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.542584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1061/2096] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:57 2022] DELETE /identity/v3/projects/9b64745240df4bc6bb67d2f3490c3dad => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:57.547052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:57.548537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:57.633678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cddf4-35a8-4c63-af9e-fde8ba1c4ecc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:57.640225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:57.641492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:57.642064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:57.642406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] PATH_INFO: `/v3/users/b5d726129b944917b740478282ece1fe` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:57.643711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d726129b944917b740478282ece1fe)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:57.647121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:57.840455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d726129b944917b740478282ece1fe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.850654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d726129b944917b740478282ece1fe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.851620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d726129b944917b740478282ece1fe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.852262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d726129b944917b740478282ece1fe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.920792 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-355bb32b-e284-47bf-a883-27568215ee25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d726129b944917b740478282ece1fe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:57.939440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1036/2097] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:55:57 2022] DELETE /identity/v3/users/b5d726129b944917b740478282ece1fe => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:57.976083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:57.977541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.057194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a88f3-7446-4277-8602-ff8ce15b937b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.125033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.126424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.126921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.127409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] PATH_INFO: `/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.128840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4b302ebb4f42f29cdf57e52fc84b5d)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.131420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.254383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4b302ebb4f42f29cdf57e52fc84b5d', 'request_id': 'req-fd7948af-631e-49c9-97f8-c40040d9902d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.263012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4b302ebb4f42f29cdf57e52fc84b5d', 'request_id': 'req-fd7948af-631e-49c9-97f8-c40040d9902d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.349426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4b302ebb4f42f29cdf57e52fc84b5d', 'request_id': 'req-fd7948af-631e-49c9-97f8-c40040d9902d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.361338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] The token cache is being invalidate because project 7b4b302ebb4f42f29cdf57e52fc84b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:58.361631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.362296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.363842 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1062/2098] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:57 2022] DELETE /identity/v3/projects/7b4b302ebb4f42f29cdf57e52fc84b5d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:58.369830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154059e-00eb-45c4-8f51-93435990fce6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.370142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154059e-00eb-45c4-8f51-93435990fce6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.370442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154059e-00eb-45c4-8f51-93435990fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.392626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1154059e-00eb-45c4-8f51-93435990fce6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:58.394121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1154059e-00eb-45c4-8f51-93435990fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.454263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1037/2099] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:58.454635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.456031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.464275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.464560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.464865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.470451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7948af-631e-49c9-97f8-c40040d9902d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.476653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.477726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.478007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.478685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] PATH_INFO: `/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.479636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fc4737626941f6bbf7b9d2cd4279eb)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.481576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.485679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:58.486934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.497373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1038/2100] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:58.501207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.511770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917e18-8053-4507-88bf-a636d4f880db None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.517066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.517889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.518312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.518629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.519488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:58.519819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.521772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.535028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1039/2101] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:55:58.556380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.567237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ecc5-6fd3-43a7-88b9-281fac925009 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.572007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.573224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.573502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.573774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.574497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.576549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.691217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fc4737626941f6bbf7b9d2cd4279eb', 'request_id': 'req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.698725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fc4737626941f6bbf7b9d2cd4279eb', 'request_id': 'req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.709306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1040/2102] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:58.714316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.783656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc8db-c980-4b07-bb64-71b6d35c9a5f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.786277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fc4737626941f6bbf7b9d2cd4279eb', 'request_id': 'req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.789557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.790221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.790806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.791889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.793105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.795542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.801193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] The token cache is being invalidate because project 87fc4737626941f6bbf7b9d2cd4279eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:55:58.801492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.802394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5f070a12-4efb-4e2c-a3f9-ddf90b7d1874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:55:58.809083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1063/2103] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:55:58 2022] DELETE /identity/v3/projects/87fc4737626941f6bbf7b9d2cd4279eb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:55:58.810796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f329b-47d4-4a08-a2ef-6664e9ceb109 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.811056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f329b-47d4-4a08-a2ef-6664e9ceb109 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.811523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f329b-47d4-4a08-a2ef-6664e9ceb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.832840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-668f329b-47d4-4a08-a2ef-6664e9ceb109 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:58.834256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-668f329b-47d4-4a08-a2ef-6664e9ceb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.850697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1064/2104] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:58.856164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.856474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.856850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.878688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1041/2105] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:58.879847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:58.881041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.883077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.885658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:58.890130 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1065/2106] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:55:58.894075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.898550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c76d1-85b5-4f55-8169-a1bbd15a2de0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.903606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fa56-6676-4d31-be0f-25550a3a91ac None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.903782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.906660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.906660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.906660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.906660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.907921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.908658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.909304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.909614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.909890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.910650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:55:58.910956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.912555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.920589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1042/2107] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:58.924321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1066/2108] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:55:58.924819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.928243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.935828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939041f9-cf12-406c-b99f-30a8a376c196 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.937649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de958-e34d-4ca8-91c2-1f20996c60cb admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.940492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.941188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.941498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.941883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.942297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.942828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.942943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.943202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.943476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.944170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:58.944940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.946086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:58.962331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1043/2109] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:58.964146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:58.973818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860003d8-7186-46d9-96e5-8ba1953b8d35 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:58.979424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:58.980466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:58.980770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:58.981078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] PATH_INFO: `/v3/projects/c985c8f8f35d402bb2f0b438aa801575/users/17669504fd1b4ff6a312f73e4cce67d9/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:58.997666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c985c8f8f35d402bb2f0b438aa801575, user_id=17669504fd1b4ff6a312f73e4cce67d9, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.000334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6809d9-0368-4f34-9377-0684e04ad37b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.035939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1067/2110] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:58 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:59.040143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.105178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7290-8885-49dd-a6fa-6bb3dee25983 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.129823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1044/2111] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:58 2022] PUT /identity/v3/projects/c985c8f8f35d402bb2f0b438aa801575/users/17669504fd1b4ff6a312f73e4cce67d9/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:59.135819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.136181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.136576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.155535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:59.156749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:59.171535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.172232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.172513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.172788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.173475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.175514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.223804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1045/2112] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:59.233760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.235277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:59.258214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1068/2113] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:59 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:55:59.262304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.271896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd7f43-3ccb-45c9-b9a8-8efcb4980b9b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.277098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.277739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.278041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.278355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.279079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.280666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.291014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1069/2114] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:59.293651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e28df-580c-4a00-8c3a-f071a8b57192 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.294823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.297790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.298466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.298801 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.299074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.304337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651907a4-7178-4828-adce-7ea48caac430 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.308831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.309600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.310278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.310379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.310590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.310865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.311583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.313195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858619-11c7-42f7-94e4-540886d84b1d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.319735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1046/2115] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:55:59.323623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1070/2116] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:55:59.327751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.337733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117950a-2464-4360-a840-1bc0e173d9af service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.342928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.343799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.344077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.345027 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] PATH_INFO: `/v3/projects/a6bed396b42145b491931e76612139ea/users/5d463f640d054648b98a4e1194a4cbee/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.359633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6bed396b42145b491931e76612139ea, user_id=5d463f640d054648b98a4e1194a4cbee, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.362308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.457677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1047/2117] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:59 2022] PUT /identity/v3/projects/a6bed396b42145b491931e76612139ea/users/5d463f640d054648b98a4e1194a4cbee/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:55:59.469461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.470009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.470009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.496615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] MFA Rules not processed for user `5d463f640d054648b98a4e1194a4cbee`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:55:59.497887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:55:59.560311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1071/2118] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:55:59.571504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.634068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01bb34-6bfa-46bd-8f21-90f70faf3ca9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.640410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.641168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.641636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.642080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.642856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.644785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.745640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1048/2119] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:55:59 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:59.749930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.762528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711c33-8f28-4521-88ff-46a048f290cb None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.822308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.823641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.824021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.824368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.825112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.827388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.910400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1072/2120] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:55:59 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:55:59.913981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.929665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ae9bb-b5a0-4ece-a736-8e8b8fe947cc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:55:59.942910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:55:59.943761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:55:59.944099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:55:59.944662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:55:59.946428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:55:59.950258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:55:59.970615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1049/2121] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:55:59.976900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:55:59.990554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdfe40-7d7e-4d74-9224-dca1d471b30e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:00.002168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:00.002168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.002168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.002168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] PATH_INFO: `/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5/users/031a0b628d64490aa83e3003784b0a7d/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.016472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e79cef5194d7abcd491bbfa5be0d5, user_id=031a0b628d64490aa83e3003784b0a7d, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:00.019250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:00.092522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1073/2122] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:55:59 2022] PUT /identity/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5/users/031a0b628d64490aa83e3003784b0a7d/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:00.097666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:00.109094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce61f0-aae8-47af-96e6-4879e06471b6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:00.171817 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:00.172490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.172769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.173261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.174000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:00.175709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acca9e1-a677-4161-80f7-956695339606 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:00.190176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1050/2123] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:00.193010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:00.217719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e727-3097-412c-a4fc-4f774655a4a6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:00.223102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:00.224229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.224547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.225125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] PATH_INFO: `/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5/users/031a0b628d64490aa83e3003784b0a7d/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.227663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e79cef5194d7abcd491bbfa5be0d5, user_id=031a0b628d64490aa83e3003784b0a7d, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:00.230948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:00.247460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1074/2124] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:00 2022] PUT /identity/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5/users/031a0b628d64490aa83e3003784b0a7d/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:00.258364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e437-769e-4c97-a577-913105c92f64 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.259044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e437-769e-4c97-a577-913105c92f64 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.259674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e437-769e-4c97-a577-913105c92f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.292988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3615e437-769e-4c97-a577-913105c92f64 None None] MFA Rules not processed for user `031a0b628d64490aa83e3003784b0a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:00.294563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3615e437-769e-4c97-a577-913105c92f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:00.379081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1051/2125] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:00.388316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:00.388686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:00.445967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08c65-1537-4b3e-8775-f32b5836fdbd admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:00.449632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:00.450424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.450705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.450976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.460421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:00.461906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:00.471998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1075/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:00.932395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412113f5-7245-4663-a997-623513e006a9 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:00.932860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412113f5-7245-4663-a997-623513e006a9 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:00.933089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412113f5-7245-4663-a997-623513e006a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:00.967598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-412113f5-7245-4663-a997-623513e006a9 None None] MFA Rules not processed for user `17669504fd1b4ff6a312f73e4cce67d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:00.973846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-412113f5-7245-4663-a997-623513e006a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:01.050094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1052/2127] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:01.080900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:01.097497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50330264-1848-4c4b-ac00-d1e854e0a829 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:01.102107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:01.102759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:01.103037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:01.103309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:01.112874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:01.114386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8e67-c23f-4bf1-ba0d-8406e994b9c6 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:01.123860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1076/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:03.161768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:03.161768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:03.161768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:03.179384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] MFA Rules not processed for user `17669504fd1b4ff6a312f73e4cce67d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:03.180535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:03.190705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1053/2129] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:03.230808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810f92-62b9-4c05-ba0e-1a043193c4e4 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:03.231795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810f92-62b9-4c05-ba0e-1a043193c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:03.231795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810f92-62b9-4c05-ba0e-1a043193c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:03.261631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a7810f92-62b9-4c05-ba0e-1a043193c4e4 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:03.263347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a7810f92-62b9-4c05-ba0e-1a043193c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:03.344837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1077/2130] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:03.399112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:03.401353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:03.501238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e038-f362-44b0-9527-158197d9a99b None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:03.508835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:03.509513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:03.509797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:03.510641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:03.520746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:03.522512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:03.533127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1054/2131] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:56:04.825248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:04.826311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:04.826879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:04.840424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:04.857714 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:04.859028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:04.867169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1078/2132] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:04.884473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:04.898579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871bd7-059f-4e3f-8e54-1349e413ad66 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:04.904154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:04.905039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:04.905476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:04.905902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:04.917319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:04.919325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e8f7-d9d3-4f35-a2ca-3fd919d8fad0 service swift] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:04.923693 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11cfa-88e2-4315-9dbf-1ff6a174ef5d service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:04.928898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1079/2133] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 13:56:04.931592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:04.932581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:04.932867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:04.933151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] PATH_INFO: `/v3/users/5d463f640d054648b98a4e1194a4cbee` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:04.934782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d463f640d054648b98a4e1194a4cbee)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:04.937743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:05.190619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d463f640d054648b98a4e1194a4cbee'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:05.201970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d463f640d054648b98a4e1194a4cbee'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:05.202765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d463f640d054648b98a4e1194a4cbee'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:05.203636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d463f640d054648b98a4e1194a4cbee'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:05.332609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d463f640d054648b98a4e1194a4cbee'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:05.353086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1055/2134] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:04 2022] DELETE /identity/v3/users/5d463f640d054648b98a4e1194a4cbee => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:05.357640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6c1b9-1252-4732-8aab-f4b2a2fbc95c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:05.358332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6c1b9-1252-4732-8aab-f4b2a2fbc95c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:05.359507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6c1b9-1252-4732-8aab-f4b2a2fbc95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:05.391286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fcd6c1b9-1252-4732-8aab-f4b2a2fbc95c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:05.392063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fcd6c1b9-1252-4732-8aab-f4b2a2fbc95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:05.473770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1080/2135] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:05.488290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:05.490736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:05.557488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08826d-b111-4b7c-9cdc-7df67e8ccd1f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:05.561269 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:05.561928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:05.562244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:05.562518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:05.573405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:05.575048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:05.587374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1056/2136] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:05.816524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:05.816850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:05.817082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:05.835830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:05.837054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:05.914993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:05.917444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:05.930200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1081/2137] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:05.944707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:05.945547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3a39-9855-4f24-a65e-2c46a62a1dd4 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:05.946785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:05.952922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:05.954209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:05.954719 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:05.955180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] PATH_INFO: `/v3/users/a34258e15548496ab15bff7b7603b21e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:05.957671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34258e15548496ab15bff7b7603b21e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:05.962430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:06.051115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89fb9e-c8b2-48e3-a5b1-41a39aac80ae None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:06.059165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:06.060004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.060360 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.060709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:06.070290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:06.072131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:06.083578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1082/2138] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 13:56:06.271814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:06.273056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:06.293898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0281-cfa4-4ccf-877d-507a0905bdf8 service swift] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:06.309322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:06.310524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.310895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.311193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34258e15548496ab15bff7b7603b21e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.311296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] PATH_INFO: `/v3/projects/a6bed396b42145b491931e76612139ea` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:06.312579 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6bed396b42145b491931e76612139ea)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:06.314658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:06.319669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34258e15548496ab15bff7b7603b21e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.320349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34258e15548496ab15bff7b7603b21e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.320948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34258e15548496ab15bff7b7603b21e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.443657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a3b7f098-cb88-4e50-b9c2-82cebdda598b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34258e15548496ab15bff7b7603b21e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.462682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6bed396b42145b491931e76612139ea', 'request_id': 'req-996d3fcb-8820-4b67-a949-aa18a7931ac2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.465824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1057/2139] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:05 2022] DELETE /identity/v3/users/a34258e15548496ab15bff7b7603b21e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:06.471326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.471612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.471938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:06.475645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6bed396b42145b491931e76612139ea', 'request_id': 'req-996d3fcb-8820-4b67-a949-aa18a7931ac2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.492786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:06.494001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:06.561783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1058/2140] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:06.563469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6bed396b42145b491931e76612139ea', 'request_id': 'req-996d3fcb-8820-4b67-a949-aa18a7931ac2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.573260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:06.574709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:06.583432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] The token cache is being invalidate because project a6bed396b42145b491931e76612139ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:06.584652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.585505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:06.588666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1083/2141] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:06 2022] DELETE /identity/v3/projects/a6bed396b42145b491931e76612139ea => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:06.592189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:06.594304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:06.685318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c50ce-f79d-4dcc-ba57-571107252272 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:06.687974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:06.688887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.689698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.690206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:06.692369 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:06.708294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:06.709752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77d5a7-356e-4de9-b04f-51bf3b3ae983 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:06.722732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1059/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:06.734261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3fcb-8820-4b67-a949-aa18a7931ac2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:06.748702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:06.754286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.754286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.754286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] PATH_INFO: `/v3/users/031a0b628d64490aa83e3003784b0a7d` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:06.754286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=031a0b628d64490aa83e3003784b0a7d)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:06.754286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:06.976744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:06.977723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:06.978379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:07.008256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:07.009499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:07.085894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1060/2143] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:07.109917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:07.111660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:07.143622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031a0b628d64490aa83e3003784b0a7d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.165791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031a0b628d64490aa83e3003784b0a7d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.166664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031a0b628d64490aa83e3003784b0a7d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.225041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7dcc-12fc-4174-a5ab-1c7a5c846d6c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:07.231861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:07.233121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:07.233491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:07.233843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:07.236036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:07.255618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:07.257460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:07.269675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1061/2144] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:56:07.286920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031a0b628d64490aa83e3003784b0a7d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.287730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031a0b628d64490aa83e3003784b0a7d'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.322064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1084/2145] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:06 2022] DELETE /identity/v3/users/031a0b628d64490aa83e3003784b0a7d => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:07.431055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:07.432980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:07.447035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f730d2-538a-44e4-8f81-1b599492add8 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:07.570308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:07.571181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:07.571462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:07.571734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] PATH_INFO: `/v3/projects/2aac8b6f4af14fc1bcba0fbb6ff1edb0` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:07.573557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aac8b6f4af14fc1bcba0fbb6ff1edb0)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:07.575490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:07.743888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aac8b6f4af14fc1bcba0fbb6ff1edb0', 'request_id': 'req-584345e9-9817-4fbf-ab21-5e4a13611793'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.752530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aac8b6f4af14fc1bcba0fbb6ff1edb0', 'request_id': 'req-584345e9-9817-4fbf-ab21-5e4a13611793'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.862428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aac8b6f4af14fc1bcba0fbb6ff1edb0', 'request_id': 'req-584345e9-9817-4fbf-ab21-5e4a13611793'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.878104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] The token cache is being invalidate because project 2aac8b6f4af14fc1bcba0fbb6ff1edb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:07.878505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.879314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:07.881587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1062/2146] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:07 2022] DELETE /identity/v3/projects/2aac8b6f4af14fc1bcba0fbb6ff1edb0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:07.886564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:07.897358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8b4f-cd90-4606-aa9c-bf5fd69c49fc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:07.967801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:07.969216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:07.969754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:07.970203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] PATH_INFO: `/v3/users/2f954513027644129e6224092dad718f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:07.971986 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f954513027644129e6224092dad718f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:07.974398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:08.034302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:08.036148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:08.054252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584345e9-9817-4fbf-ab21-5e4a13611793 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:08.061602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:08.063266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:08.063626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:08.063912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] PATH_INFO: `/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:08.065477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6e79cef5194d7abcd491bbfa5be0d5)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:08.068251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:08.202513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f954513027644129e6224092dad718f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.217384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f954513027644129e6224092dad718f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.223938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f954513027644129e6224092dad718f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.243490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6e79cef5194d7abcd491bbfa5be0d5', 'request_id': 'req-8330be03-6994-4d24-b7bf-472756682dcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.251672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6e79cef5194d7abcd491bbfa5be0d5', 'request_id': 'req-8330be03-6994-4d24-b7bf-472756682dcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.304116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f954513027644129e6224092dad718f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.305098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-942d984a-fc98-4ad6-8a04-48112e658b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f954513027644129e6224092dad718f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.343288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1085/2147] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:07 2022] DELETE /identity/v3/users/2f954513027644129e6224092dad718f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:08.426226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6e79cef5194d7abcd491bbfa5be0d5', 'request_id': 'req-8330be03-6994-4d24-b7bf-472756682dcd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.461652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] The token cache is being invalidate because project 1c6e79cef5194d7abcd491bbfa5be0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:08.462835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.465310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8330be03-6994-4d24-b7bf-472756682dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:08.469283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1063/2148] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:08 2022] DELETE /identity/v3/projects/1c6e79cef5194d7abcd491bbfa5be0d5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:08.476058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:08.476578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:08.477008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:08.509717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:08.511453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:08.628175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1086/2149] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:08.634442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:08.635725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:08.636150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:08.675995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:08.683800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:08.713845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1064/2150] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:08.716450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:08.734085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ad06-a193-4694-a055-28159e877baf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:08.740711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:08.741585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:08.741970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:08.742403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:08.743303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:08.743709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:08.746685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:08.774673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1087/2151] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:08.777851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:08.794961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301fab-16cf-49dc-b9fb-0a7ef1156b82 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:08.808575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:08.809606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:08.810172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:08.810655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:08.812681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:08.815041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:08.986399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1065/2152] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:08 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:08.989452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.004875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801e54-247f-4c6d-88f7-c356544696fe admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.042433 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.044831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:09.082450 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.083506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.084028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.084305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.085355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.088141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.180370 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997667b1-7a9c-4cef-8617-ca3bc6b0f843 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.192571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.193860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.194222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.194572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] PATH_INFO: `/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.195875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1ee1bcb75a474ba4a9a8fcead47241)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.198539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.208333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1088/2153] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:08 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:09.219313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.239349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b5da-75ce-47c3-8147-a6ebdb3fd921 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.249680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.250497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.250850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.253000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.254037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.256731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.301479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1089/2154] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:09.305769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.323451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2f89-a7bd-444a-a220-4a2a3fa81290 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.330735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.334096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.334653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.335102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.337840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.339949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.356391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1090/2155] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:09.358895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.372223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f5992-46b0-4bfa-ba8d-cdc1d245188c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.383524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.384413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.384770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.385060 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] PATH_INFO: `/v3/projects/f31f69a979454f2aacc317eb84624222/users/7c80c47e1a514b7797984d5aae3dc590/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.393536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1ee1bcb75a474ba4a9a8fcead47241', 'request_id': 'req-efa74794-8fad-474d-8901-52dfb6d20b2f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:09.402699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31f69a979454f2aacc317eb84624222, user_id=7c80c47e1a514b7797984d5aae3dc590, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.404434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1ee1bcb75a474ba4a9a8fcead47241', 'request_id': 'req-efa74794-8fad-474d-8901-52dfb6d20b2f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:09.415624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a07bc9-968e-4643-853a-96f53e6a995f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.629165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1ee1bcb75a474ba4a9a8fcead47241', 'request_id': 'req-efa74794-8fad-474d-8901-52dfb6d20b2f'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:09.633128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1091/2156] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:09 2022] PUT /identity/v3/projects/f31f69a979454f2aacc317eb84624222/users/7c80c47e1a514b7797984d5aae3dc590/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:09.641836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] The token cache is being invalidate because project ac1ee1bcb75a474ba4a9a8fcead47241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:09.642156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:09.642872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-efa74794-8fad-474d-8901-52dfb6d20b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:09.644373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.644555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1066/2157] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:09 2022] DELETE /identity/v3/projects/ac1ee1bcb75a474ba4a9a8fcead47241 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:09.644653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.644907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.649182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaace5e-6e03-4e6d-8027-8a53203daaff None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.649481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaace5e-6e03-4e6d-8027-8a53203daaff None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.649759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaace5e-6e03-4e6d-8027-8a53203daaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.670218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-dbaace5e-6e03-4e6d-8027-8a53203daaff None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:09.671428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dbaace5e-6e03-4e6d-8027-8a53203daaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:09.673563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] MFA Rules not processed for user `7c80c47e1a514b7797984d5aae3dc590`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:09.674773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:09.748935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1092/2158] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:09.753441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.754899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:09.755544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1067/2159] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:09.757144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.757565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.757872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.771877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3efe6c-5029-4d2d-9df5-09b41410e4a1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.780702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.781529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.781820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.782341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.783046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.784163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:09.784983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.785381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:09.798537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1068/2160] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:09.802700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.813080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1b9c-0542-4e85-9530-96288b20fa70 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.819591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.822697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.823321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.826081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.828340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:09.828340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.828891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.843766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1069/2161] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:09.848974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:09.862438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989ad6-2310-4054-9631-aba5597ea47d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:09.867511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:09.868606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:09.868882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:09.869161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:09.869891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:09.871911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:09.966951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1093/2162] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:09.968213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.046650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb157447-141a-4c0b-be77-52e205989cda admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.051402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.052073 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.052348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.052616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.053387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.055318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.079557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1070/2163] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/projects => generated 397 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:10.085294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.159207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1094/2164] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:09 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:10.161321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.164380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f452-8633-4899-ab71-c0c3e268d878 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.169659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.170363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.170646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.170919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.171616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.173584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.174646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7e54-f372-4007-b1a2-6baef156e8a1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.180032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.181106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.182553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.183585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.184945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.187032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.197952 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1095/2165] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:10.202186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.214396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d231ca-3666-4b37-91a0-bdb4d14151da admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.228243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.229931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.229931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.231892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] PATH_INFO: `/v3/projects/e22a81575a034e2a82a7c1391f6de4ef/users/a623678ba37346f6825dd89aa6d8d17c/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.277174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22a81575a034e2a82a7c1391f6de4ef, user_id=a623678ba37346f6825dd89aa6d8d17c, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.280514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.305503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1071/2166] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:10 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:10.309930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.319993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962620-6eae-44fa-8edd-ac4e63fecf69 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.328360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.329024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.329302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.329570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.330442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.332609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.343637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1072/2167] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:10.347311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.358192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170343-4e9b-425d-9552-1de29752aa39 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.362891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.363548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.363833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.364106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.364830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.366466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.383005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1073/2168] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:10.387204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.398729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee54da-3087-4312-b0a4-549321153ea2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.405664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.406624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.406900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.407307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] PATH_INFO: `/v3/projects/a08b185056914a21aed786fca9d3ec42/users/b020bbec35a64d498121b28fc2cbff60/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.425657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08b185056914a21aed786fca9d3ec42, user_id=b020bbec35a64d498121b28fc2cbff60, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.442050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c08c1-4f9c-4c0c-b845-128c8ab47b26 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.446706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1096/2169] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:10 2022] PUT /identity/v3/projects/e22a81575a034e2a82a7c1391f6de4ef/users/a623678ba37346f6825dd89aa6d8d17c/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:10.447797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.528366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9768590-4212-444a-9d4c-890d7521bb11 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.530194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.530693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.531168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.531330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.532209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.533981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.545094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1097/2170] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:10.549209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.554976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1074/2171] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:10 2022] PUT /identity/v3/projects/a08b185056914a21aed786fca9d3ec42/users/b020bbec35a64d498121b28fc2cbff60/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:10.564642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa523f-4a57-4232-b556-edde4f59e83c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.574577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.574857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.575218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.633785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] MFA Rules not processed for user `b020bbec35a64d498121b28fc2cbff60`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:10.635325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:10.656278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.657202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.657616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.657910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] PATH_INFO: `/v3/projects/e22a81575a034e2a82a7c1391f6de4ef/users/a623678ba37346f6825dd89aa6d8d17c/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.666808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22a81575a034e2a82a7c1391f6de4ef, user_id=a623678ba37346f6825dd89aa6d8d17c, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.679402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a4c5f-4d49-407c-8e40-0b05cde7ac22 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.707896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1098/2172] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:10 2022] PUT /identity/v3/projects/e22a81575a034e2a82a7c1391f6de4ef/users/a623678ba37346f6825dd89aa6d8d17c/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:10.721886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.722495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.722776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.745163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1075/2173] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:10.750788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.770312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e84a4-d2cf-40af-9dfd-1f42e82164f4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.778915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] MFA Rules not processed for user `a623678ba37346f6825dd89aa6d8d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:10.781592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:10.880123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.881353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.881449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.881845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.882724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.885120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:10.932708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1099/2174] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:10.933658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:10.936206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:10.952339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48139b-9cd0-4dcd-a6b9-afd8579359dc None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:10.957947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:10.958991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:10.959279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:10.959554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] PATH_INFO: `/v3/users/e81a6f59026d403f93ee29de20119da6` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:10.960796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81a6f59026d403f93ee29de20119da6)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:10.962791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.077028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1076/2175] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:10 2022] POST /identity/v3/projects => generated 401 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:11.077898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.079705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:11.148967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856b36b-1177-4e81-a817-b3c765b2d07b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.153383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.154054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.154339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.154612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.226240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.227707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.242098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1077/2176] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:11.251051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.322694 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81a6f59026d403f93ee29de20119da6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:11.345547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81a6f59026d403f93ee29de20119da6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:11.347027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81a6f59026d403f93ee29de20119da6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:11.351957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121823-4e2d-4ddc-ac56-ce2d28df51ed service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.358396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.359244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.359524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.359804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.360759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.365148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.452507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81a6f59026d403f93ee29de20119da6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:11.456181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fdf37b3b-9244-4615-ae46-16d228010c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81a6f59026d403f93ee29de20119da6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:11.486400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1100/2177] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:10 2022] DELETE /identity/v3/users/e81a6f59026d403f93ee29de20119da6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:11.493286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.493539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.493807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.500505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1078/2178] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:11 2022] POST /identity/v3/users => generated 307 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:11.505265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.508145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:11.527802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10bf0f-b54e-4cd2-96e5-4afded8dc7dd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.548436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:11.549927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:11.632823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.633774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.634395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.635379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.636670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.640424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.653621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1079/2179] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:11.662980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.685307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7606-e5bd-4a4f-9e0c-d604af3720b1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.686601 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1101/2180] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:11.692168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.693170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.695896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.695896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] PATH_INFO: `/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1/users/1a159a6fe6f0472ba707bf32a1c0c800/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.712722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f97d09f0f2741bd9be198dfc191e7b1, user_id=1a159a6fe6f0472ba707bf32a1c0c800, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.716227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.720926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.723568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:11.810518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b7ede-7138-433b-bab7-a40fc1880a6a None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.816896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.817079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.817487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.817865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.830174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.831807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.849111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1080/2181] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:11 2022] PUT /identity/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1/users/1a159a6fe6f0472ba707bf32a1c0c800/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:11.850825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:11.851909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1102/2182] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:11.962588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da845-0531-43bf-8198-d65618f4024d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:11.969313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:11.970298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:11.970596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:11.970861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:11.971879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:11.973849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119f6d-b05b-4d6b-b680-c09c7d0bde55 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:11.986707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1081/2183] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:11.991165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:12.002532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac74a-7306-4f2d-a333-3f227a1f83c4 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:12.007861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:12.008923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:12.009224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:12.010287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] PATH_INFO: `/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1/users/1a159a6fe6f0472ba707bf32a1c0c800/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:12.012298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f97d09f0f2741bd9be198dfc191e7b1, user_id=1a159a6fe6f0472ba707bf32a1c0c800, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:12.016206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:12.030163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1103/2184] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:11 2022] PUT /identity/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1/users/1a159a6fe6f0472ba707bf32a1c0c800/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:12.041699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:12.042913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:12.042913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:12.076724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] MFA Rules not processed for user `1a159a6fe6f0472ba707bf32a1c0c800`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:12.078130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:12.167628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1082/2185] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:12.233108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:12.236348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:12.347022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b176c2-3a80-48b0-9669-81c05a2121e9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:12.354535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:12.355593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:12.356050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:12.356500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:12.373047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:12.375624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:12.395128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1104/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:12.433724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:12.437618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:12.529976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee7d66-91a6-4ce7-9fb3-f0b938e46a42 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:12.542499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:12.543271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:12.543546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:12.543815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] PATH_INFO: `/v3/projects/13cfbe72dcc24c108503a3e3b304d435` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:12.545017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cfbe72dcc24c108503a3e3b304d435)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:12.547016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:12.670854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cfbe72dcc24c108503a3e3b304d435', 'request_id': 'req-43664752-0c34-478f-8f56-a1cc56e30101'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:12.678299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cfbe72dcc24c108503a3e3b304d435', 'request_id': 'req-43664752-0c34-478f-8f56-a1cc56e30101'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:12.758608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:12.772499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19c66-799b-4127-bd23-a9988cefe522 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:12.844870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cfbe72dcc24c108503a3e3b304d435', 'request_id': 'req-43664752-0c34-478f-8f56-a1cc56e30101'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:12.859064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:12.860204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:12.860674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:12.861167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:12.863501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:12.871457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] The token cache is being invalidate because project 13cfbe72dcc24c108503a3e3b304d435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:12.871909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:12.875682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:12.878582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1083/2187] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:12 2022] DELETE /identity/v3/projects/13cfbe72dcc24c108503a3e3b304d435 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:12.899117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:12.914996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:12.973068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:12.975402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:12.988856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1105/2188] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:56:13.077751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664752-0c34-478f-8f56-a1cc56e30101 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:13.084867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a623678ba37346f6825dd89aa6d8d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e22a81575a034e2a82a7c1391f6de4ef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:13.087486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:13.087773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:13.088194 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:13.089377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:13.089377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:13.092114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:13.121886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1084/2189] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:13.126418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:13.128713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:13.150836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54cb34-193a-4957-964a-dbcd1d332549 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:13.167340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a623678ba37346f6825dd89aa6d8d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e22a81575a034e2a82a7c1391f6de4ef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:13.167340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:13.167340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:13.171646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:13.171646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:13.171646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:13.305955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1106/2190] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:13 2022] POST /identity/v3/projects => generated 354 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:13.310917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:13.335326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ce28e-9b9d-4c69-9ecd-4789062b3ae9 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:13.440554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a623678ba37346f6825dd89aa6d8d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e22a81575a034e2a82a7c1391f6de4ef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:13.441508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:13.441870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:13.442309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:13.443960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:13.444349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:13.446307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea917-2c33-45e7-9571-31c57028cdc0 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:13.462070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1085/2191] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:13.642516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:13.658405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:13.658799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:13.659485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d05b2f-efd1-4d53-837d-6d9223fb8340 tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:13.659745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:13.665315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a623678ba37346f6825dd89aa6d8d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e22a81575a034e2a82a7c1391f6de4ef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:13.667498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:13.673765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:13.673765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] PATH_INFO: `/v3/projects/710bc70e000547e59409399cb20d4197` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:13.673765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorizing `identity:delete_project(project_id=710bc70e000547e59409399cb20d4197)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:13.673765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:13.737011 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:13.738620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:13.816747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1086/2192] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:13.843076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:13.845686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:13.873792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710bc70e000547e59409399cb20d4197', 'request_id': 'req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:13.882344 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710bc70e000547e59409399cb20d4197', 'request_id': 'req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:13.945859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b851fa-63af-476c-bdaa-2edbf7db1156 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:14.012582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:14.013421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:14.013791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:14.014177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:14.032143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710bc70e000547e59409399cb20d4197', 'request_id': 'req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:14.044338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] The token cache is being invalidate because project 710bc70e000547e59409399cb20d4197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:14.044635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:14.082889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:14.082889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1107/2193] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:13 2022] DELETE /identity/v3/projects/710bc70e000547e59409399cb20d4197 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:14.084037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:14.087560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28255-ac0a-48c4-a3bf-5526883531d2 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:14.100329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1087/2194] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:56:15.088921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:15.092317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:15.283025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eacbc-711a-4c83-a6a4-27b9e096b93f tempest-VolumeQuotaClassesTest-1670830105 tempest-VolumeQuotaClassesTest-1670830105-project-admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:15.289745 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:15.290983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:15.292065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:15.292490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] PATH_INFO: `/v3/users/7c80c47e1a514b7797984d5aae3dc590` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:15.294233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c80c47e1a514b7797984d5aae3dc590)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:15.296351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:15.538674 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c80c47e1a514b7797984d5aae3dc590'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:15.546715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c80c47e1a514b7797984d5aae3dc590'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:15.547443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c80c47e1a514b7797984d5aae3dc590'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:15.618611 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c80c47e1a514b7797984d5aae3dc590'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:15.619421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c80c47e1a514b7797984d5aae3dc590'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:15.648748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1108/2195] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:15 2022] DELETE /identity/v3/users/7c80c47e1a514b7797984d5aae3dc590 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:15.657012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:15.658481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:15.659234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:15.692245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:15.694863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:15.828795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1088/2196] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:15.865474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:15.868340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:16.047592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa743e6-d517-4fd8-8d7a-474602588342 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:16.049897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:16.050584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:16.050908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:16.051178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:16.063176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:16.071289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:16.084847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1109/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:16.891114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:16.893244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:16.913730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc856d-90e4-400a-aeb2-b0676b7ffb16 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:16.925673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:16.930244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:16.930244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:16.930244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] PATH_INFO: `/v3/projects/f31f69a979454f2aacc317eb84624222` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:16.931267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31f69a979454f2aacc317eb84624222)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:16.936024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:17.119229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31f69a979454f2aacc317eb84624222', 'request_id': 'req-7ff2a63a-d53a-4e8a-aae8-a7b643206351'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.134230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31f69a979454f2aacc317eb84624222', 'request_id': 'req-7ff2a63a-d53a-4e8a-aae8-a7b643206351'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.233637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31f69a979454f2aacc317eb84624222', 'request_id': 'req-7ff2a63a-d53a-4e8a-aae8-a7b643206351'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.248739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] The token cache is being invalidate because project f31f69a979454f2aacc317eb84624222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:17.249299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.250153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.252448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1089/2198] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:16 2022] DELETE /identity/v3/projects/f31f69a979454f2aacc317eb84624222 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:17.256303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:17.270355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb611-e784-4c60-bee8-d715f4d96622 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:17.370834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:17.371923 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:17.372299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:17.374051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] PATH_INFO: `/v3/users/a623678ba37346f6825dd89aa6d8d17c` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:17.375274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a623678ba37346f6825dd89aa6d8d17c)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:17.377673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:17.645470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a623678ba37346f6825dd89aa6d8d17c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.663508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a623678ba37346f6825dd89aa6d8d17c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.664326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a623678ba37346f6825dd89aa6d8d17c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.780906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a623678ba37346f6825dd89aa6d8d17c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.781780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a623678ba37346f6825dd89aa6d8d17c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:17.819211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1110/2199] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:17 2022] DELETE /identity/v3/users/a623678ba37346f6825dd89aa6d8d17c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:18.544625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:18.546650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:18.562928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a63a-d53a-4e8a-aae8-a7b643206351 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:18.624861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:18.625738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:18.626042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:18.626359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] PATH_INFO: `/v3/projects/e22a81575a034e2a82a7c1391f6de4ef` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:18.627561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22a81575a034e2a82a7c1391f6de4ef)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:18.629552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:18.860605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22a81575a034e2a82a7c1391f6de4ef', 'request_id': 'req-f31c726f-7b38-4142-9db1-4fd7b34b9f65'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:18.876935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22a81575a034e2a82a7c1391f6de4ef', 'request_id': 'req-f31c726f-7b38-4142-9db1-4fd7b34b9f65'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:18.963322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:18.966326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:18.971477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22a81575a034e2a82a7c1391f6de4ef', 'request_id': 'req-f31c726f-7b38-4142-9db1-4fd7b34b9f65'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:18.981893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c827a-2eed-4273-86c1-f61c8f5ca556 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:18.985356 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] The token cache is being invalidate because project e22a81575a034e2a82a7c1391f6de4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:18.985823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:18.986783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f31c726f-7b38-4142-9db1-4fd7b34b9f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:18.988822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1090/2200] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:18 2022] DELETE /identity/v3/projects/e22a81575a034e2a82a7c1391f6de4ef => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:19.000368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81163f-fe18-453b-91a8-1def502b4ab3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.012468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81163f-fe18-453b-91a8-1def502b4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.018107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81163f-fe18-453b-91a8-1def502b4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.090284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-be81163f-fe18-453b-91a8-1def502b4ab3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:19.091502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-be81163f-fe18-453b-91a8-1def502b4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:19.113047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.113867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.114203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.114479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] PATH_INFO: `/v3/users/b020bbec35a64d498121b28fc2cbff60` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.115695 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b020bbec35a64d498121b28fc2cbff60)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.117922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:19.223708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1091/2201] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:19.233944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.233944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.233944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.270458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:19.271796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:19.281789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1092/2202] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:19.285836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:19.295723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0711e-e97a-4495-9b4b-74a14f7f2b5d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:19.301476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.302692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.303631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.303631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.304326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:19.304959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.306545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:19.325330 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1093/2203] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:56:19.330289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:19.344786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f9d0-805e-4126-9718-d11d2467a8d4 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:19.362721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.362721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.362721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.362721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.363297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.363297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:19.376247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b020bbec35a64d498121b28fc2cbff60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:19.389361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b020bbec35a64d498121b28fc2cbff60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:19.390605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b020bbec35a64d498121b28fc2cbff60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:19.490137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1094/2204] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:19 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:19.494133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:19.497316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:19.506946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b020bbec35a64d498121b28fc2cbff60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:19.508066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-d5c35a0d-35f4-4827-9e81-b1f414632cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b020bbec35a64d498121b28fc2cbff60'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:19.553938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1111/2205] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:18 2022] DELETE /identity/v3/users/b020bbec35a64d498121b28fc2cbff60 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:19.558678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.559274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.559550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.613129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:19.615413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:19.632225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a4d87-c395-454a-ae32-e9ab30517361 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:19.702866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1112/2206] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:19.711643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:19.718184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:19.724896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.725640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.725978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.726306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.727646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.730445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:19.805830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d14f6-e9a0-4aed-9653-da1cdd754c17 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:19.810545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.811300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.811675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.812036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.865299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.866964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:19.893653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1113/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:56:19.934554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:19.935208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1095/2208] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:19 2022] POST /identity/v3/users => generated 294 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:19.953350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce94cf-6d28-4c7f-9c45-69ad5b7326de service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:19.975788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:19.976929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:19.976929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:19.976929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:19.977209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:19.982574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:20.010410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1114/2209] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:20.014883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:20.041532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1cc4c-3cec-456b-94c1-c2ee2cc56929 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:20.055409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:20.056854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:20.057292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:20.058363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:20.062726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:20.062726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17515559-5ce4-4607-933d-728406c16116 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:20.081672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1096/2210] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:20.083249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:20.109891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c63a-76ca-48e9-b675-569aef448e30 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:20.127770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:20.128693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:20.129034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:20.129398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] PATH_INFO: `/v3/projects/14666e334a3c47fc844be9ef7b2eca9f/users/b90174094d9f4abc8ade1af5cc5f958c/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:20.153560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14666e334a3c47fc844be9ef7b2eca9f, user_id=b90174094d9f4abc8ade1af5cc5f958c, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:20.157341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:20.266418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1115/2211] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:20 2022] PUT /identity/v3/projects/14666e334a3c47fc844be9ef7b2eca9f/users/b90174094d9f4abc8ade1af5cc5f958c/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:20.276381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:20.276748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:20.277088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:20.342205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] MFA Rules not processed for user `b90174094d9f4abc8ade1af5cc5f958c`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:20.344191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:20.505124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1097/2212] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:20.506306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:20.525772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:20.527537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:20.636379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a503-9980-4871-af8e-e29c558e8d81 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:20.642847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b537-9993-49c6-97a8-08285d4156f3 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:20.647700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:20.648547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:20.648898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:20.649178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:20.649450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] PATH_INFO: `/v3/projects/a08b185056914a21aed786fca9d3ec42` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:20.649562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:20.649936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:20.650328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:20.651165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:20.651590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08b185056914a21aed786fca9d3ec42)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:20.653249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:20.657609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:20.848655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1116/2213] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:20 2022] POST /identity/v3/projects => generated 387 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:20.849746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:20.895711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08b185056914a21aed786fca9d3ec42', 'request_id': 'req-4a5cc005-6bf2-47db-87a5-bcced5c3f359'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:20.903656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08b185056914a21aed786fca9d3ec42', 'request_id': 'req-4a5cc005-6bf2-47db-87a5-bcced5c3f359'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:20.955009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5d3ae-631c-4243-a3d4-8f3afde1df83 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.009363 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08b185056914a21aed786fca9d3ec42', 'request_id': 'req-4a5cc005-6bf2-47db-87a5-bcced5c3f359'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.025386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] The token cache is being invalidate because project a08b185056914a21aed786fca9d3ec42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:21.026309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.028120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.034309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1098/2214] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:20 2022] DELETE /identity/v3/projects/a08b185056914a21aed786fca9d3ec42 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:21.036302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.037384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:21.058847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.060676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.061125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.061569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.062507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.065314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.141291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc005-6bf2-47db-87a5-bcced5c3f359 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.147561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.149058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.149345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.149621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] PATH_INFO: `/v3/users/1a159a6fe6f0472ba707bf32a1c0c800` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.152332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a159a6fe6f0472ba707bf32a1c0c800)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.154479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.155378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1117/2215] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:20 2022] POST /identity/v3/users => generated 294 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:21.159387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.162352 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:21.186494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b938c-2db7-472b-889e-d0a4eb86904b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.191747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.192633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.193079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.193496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.194481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.196684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.219822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1118/2216] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:21.223531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.236804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a4ab-3812-499b-b3c3-db12852d9fb7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.243029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.243708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.244143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.244455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.245338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.246998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.268600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1119/2217] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:21.270145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.282495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d471-a5e1-4433-97aa-baded9e7c9bf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.289261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.290447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.290824 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.291223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] PATH_INFO: `/v3/projects/97b3b47008fc4fa5babe298b95261615/users/fe4dacab7d294287b6786c3760d35e60/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.311090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3b47008fc4fa5babe298b95261615, user_id=fe4dacab7d294287b6786c3760d35e60, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.313577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5d83-7185-4488-9628-8fa9a69fd5f7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.381708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a159a6fe6f0472ba707bf32a1c0c800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.399948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a159a6fe6f0472ba707bf32a1c0c800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.400952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a159a6fe6f0472ba707bf32a1c0c800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.402288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a159a6fe6f0472ba707bf32a1c0c800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.428484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1120/2218] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:21 2022] PUT /identity/v3/projects/97b3b47008fc4fa5babe298b95261615/users/fe4dacab7d294287b6786c3760d35e60/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:21.444155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.444854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.444854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.483737 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a159a6fe6f0472ba707bf32a1c0c800'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:21.536834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1099/2219] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:21 2022] DELETE /identity/v3/users/1a159a6fe6f0472ba707bf32a1c0c800 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:21.548520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] MFA Rules not processed for user `fe4dacab7d294287b6786c3760d35e60`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:21.550991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:21.664017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1121/2220] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:21.668550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.671107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:21.761749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e406d3-0ee6-4608-b1fe-d2bc17c8993e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:21.767672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:21.768425 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:21.768772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:21.769117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:21.769893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:21.772203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:21.918322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:21.918505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1100/2221] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:21 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:21.938853 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f39d-6ce7-4b65-882b-11de8af569ad None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.082347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.083326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.083741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.084019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.084805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.086871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.242727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1122/2222] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:21 2022] POST /identity/v3/users => generated 300 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:22.247748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.263853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21651223-a4b4-4dfc-bf01-432a2db0fd54 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.270736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.271518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.272067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.272495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.274239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.280498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.290962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.294340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:22.318301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f05bf9-b70c-4ea0-9d9e-e767adb2f710 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.320044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1101/2223] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:22.321058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.324782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.342320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099bf9-60c2-4091-a998-5dc006bc2e83 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.354900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.356264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.356740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.357108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] PATH_INFO: `/v3/projects/51df9015369c4f04a88fbbb5577a5ec3/users/7aaf95b6cadd422a9c80c8a91bb6a45e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.359935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.361368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.362257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] PATH_INFO: `/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.367465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f97d09f0f2741bd9be198dfc191e7b1)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.372019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.378665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51df9015369c4f04a88fbbb5577a5ec3, user_id=7aaf95b6cadd422a9c80c8a91bb6a45e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.381518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.468725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1102/2224] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:22 2022] PUT /identity/v3/projects/51df9015369c4f04a88fbbb5577a5ec3/users/7aaf95b6cadd422a9c80c8a91bb6a45e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:22.473115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.564173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2478395-e367-44a4-8ca4-2ae370839219 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.569893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.570939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.571220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.571985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.572236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.573887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.585867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1103/2225] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:22.591295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.598998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f97d09f0f2741bd9be198dfc191e7b1', 'request_id': 'req-683b6c25-26cc-491b-a65a-7a98d22fc087'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:22.614919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24791a4d-f72c-4a1e-95ae-ce845d5f2474 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.615289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f97d09f0f2741bd9be198dfc191e7b1', 'request_id': 'req-683b6c25-26cc-491b-a65a-7a98d22fc087'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:22.684364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.698326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.698326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.698326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] PATH_INFO: `/v3/projects/51df9015369c4f04a88fbbb5577a5ec3/users/7aaf95b6cadd422a9c80c8a91bb6a45e/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.698326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51df9015369c4f04a88fbbb5577a5ec3, user_id=7aaf95b6cadd422a9c80c8a91bb6a45e, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.698326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c7af8-f959-496c-a3fb-b650d6da7cbf admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.704775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1104/2226] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:22 2022] PUT /identity/v3/projects/51df9015369c4f04a88fbbb5577a5ec3/users/7aaf95b6cadd422a9c80c8a91bb6a45e/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:22.733276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.733276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.733276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.762885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] MFA Rules not processed for user `7aaf95b6cadd422a9c80c8a91bb6a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:22.764332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:22.766878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f97d09f0f2741bd9be198dfc191e7b1', 'request_id': 'req-683b6c25-26cc-491b-a65a-7a98d22fc087'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:22.785547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] The token cache is being invalidate because project 1f97d09f0f2741bd9be198dfc191e7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:22.786340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:22.787150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683b6c25-26cc-491b-a65a-7a98d22fc087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:22.789650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1123/2227] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:22 2022] DELETE /identity/v3/projects/1f97d09f0f2741bd9be198dfc191e7b1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:22.796177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47651-9533-4633-8434-71195a3c1639 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.796535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47651-9533-4633-8434-71195a3c1639 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.796883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47651-9533-4633-8434-71195a3c1639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.829521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c7f47651-9533-4633-8434-71195a3c1639 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:22.829521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c7f47651-9533-4633-8434-71195a3c1639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:22.880111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1105/2228] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:22.891867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.893372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:22.907000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1124/2229] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:22.915585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.915884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.953267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.953267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:22.953267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:22.953267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1125/2230] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:22.955537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:22.966857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8aa7-dc4b-4acd-9b4c-c7ce565812ba None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.967150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10f758-e0ce-4473-abc2-2fae4e6f68e2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:22.971529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.971916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:22.972310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.972568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:22.972742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.972848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:22.973094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.973199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:22.973817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:22.974828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.975815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.983682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:22.985208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:22.993286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1126/2231] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:22.994208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:23.003253 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1106/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:56:23.011718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451b68-d7c6-4e28-94af-914424683f0f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:23.016462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:23.017121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:23.017516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:23.017792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:23.018519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:23.020407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:23.493790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1127/2233] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:22 2022] POST /identity/v3/projects => generated 409 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:23.498340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:23.508641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0704-8cb9-4dc5-8a1d-ea77290a9390 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:23.570251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:23.571101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:23.571638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:23.571917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:23.574046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:23.574822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:23.703809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1107/2234] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:23 2022] POST /identity/v3/users => generated 305 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:23.708609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:23.731889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a41a-00fc-45fd-a104-a4b6370cb7dd admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:23.755912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:23.756708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:23.757172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:23.757551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:23.758406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:23.764279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:23.792845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1128/2235] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:23.796650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:23.807936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c700-a921-4d1a-95c0-15a1ea7bd2e0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:23.816854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:23.817712 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:23.818469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:23.818949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:23.820115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:23.821868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3f2e0-d03a-4dbc-a2d7-fd1aab86edc5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:23.857077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1108/2236] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:23.861829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:23.870258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bfba-ca9f-47fa-ab9b-c66ec72326cf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:23.878855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:23.880282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:23.880563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:23.880836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] PATH_INFO: `/v3/projects/4386b80d56e14e3793fbbd15987c9a07/users/a246652716f34f50b589eb4e4c15a9a2/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:23.898170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4386b80d56e14e3793fbbd15987c9a07, user_id=a246652716f34f50b589eb4e4c15a9a2, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:23.901439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:24.042899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1129/2237] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:23 2022] PUT /identity/v3/projects/4386b80d56e14e3793fbbd15987c9a07/users/a246652716f34f50b589eb4e4c15a9a2/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:24.058793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.059539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.059832 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.102187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] MFA Rules not processed for user `a246652716f34f50b589eb4e4c15a9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:24.105188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:24.254769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1109/2238] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:24.262572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:24.339655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ededd2-957d-476c-8b2a-f5a995f02266 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:24.345777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:24.346588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.346920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.347223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.347980 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:24.352430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:24.537082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1130/2239] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:24 2022] POST /identity/v3/projects => generated 407 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:24.541231 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:24.559538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7f381-c00d-4cc3-8755-4034f3b85b48 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:24.714275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:24.714275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.714275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.714275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.715003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:24.715003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:24.772562 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:24.775301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:24.851676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9b9c-fe07-475c-b189-a1f4f204f6e7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:24.856800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:24.857261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.857545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.857817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.861327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:24.872707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1110/2240] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:24 2022] POST /identity/v3/users => generated 310 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:24.876281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:24.892374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a20c8-243f-4bed-82d9-9c2cb5cff894 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:24.899342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:24.900064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.900298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.900604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.901457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:24.903300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:24.916601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1111/2241] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:24.920597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:24.933983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9fce-2765-4abb-87e7-253737c7535e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:24.937065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:24.939004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:24.940062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:24.940950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:24.941230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:24.941506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] PATH_INFO: `/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e/users/797db9fffefc471ba3f5735286b3d2f3/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:24.961117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1131/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:24.962392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6a2a5cc1e847f59f26f0710c02960e, user_id=797db9fffefc471ba3f5735286b3d2f3, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:24.966185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:25.063611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1112/2243] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:24 2022] PUT /identity/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e/users/797db9fffefc471ba3f5735286b3d2f3/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:25.069274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:25.086959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf7cc-2788-47b2-9e11-1395cb1ab7ff service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:25.224255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:25.224984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:25.225261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:25.225547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:25.226540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:25.230197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbd7c2-0324-415d-b4e5-83a2c69986fa admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:25.243380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1132/2244] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:25.252902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:25.265211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af1c08-de69-474c-8e3e-31a17e04e2c0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:25.271492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:25.272543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:25.272848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:25.273236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] PATH_INFO: `/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e/users/797db9fffefc471ba3f5735286b3d2f3/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:25.275908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6a2a5cc1e847f59f26f0710c02960e, user_id=797db9fffefc471ba3f5735286b3d2f3, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:25.278506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:25.308528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1113/2245] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:25 2022] PUT /identity/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e/users/797db9fffefc471ba3f5735286b3d2f3/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:25.318743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:25.319277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:25.319626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:25.381335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] MFA Rules not processed for user `797db9fffefc471ba3f5735286b3d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:25.383508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:25.516353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1133/2246] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:25.528726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:25.597151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0aa0-c760-467a-a7cd-8819e18fece5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:25.602174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:25.603138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:25.603264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:25.604249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:25.619121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:25.620906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:25.638509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1114/2247] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:26.160671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:26.174249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed48e-f8fe-4b86-9829-b362044ed678 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:26.178602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:26.179456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:26.179890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:26.180303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:26.266396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:26.268108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1d5f-4e6a-41fc-8c66-4ddd05de1b7f service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:26.305944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1134/2248] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:30.659818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:30.660884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:30.719947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f2a8-0bf5-48fe-ac44-cf2e80bd2f00 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:30.723660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:30.724300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:30.724634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:30.724910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:30.726695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:30.789910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:30.791392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:30.801140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1115/2249] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:31.118091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:31.118576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:31.118892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:31.138000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] MFA Rules not processed for user `17669504fd1b4ff6a312f73e4cce67d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:31.139279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:31.193664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1135/2250] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:34.212676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:34.228396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fe376-e2de-4123-93e7-170eb404f65d service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:34.230226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:34.230938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:34.231285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:34.231625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:34.233386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:34.303430 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:34.304916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49c034-1148-4f7e-81ac-165ce6883735 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:34.314290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1116/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:37.880825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:37.965358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d32d0-5357-4a59-ae8d-081a12b58ee9 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:37.970430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:37.972616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:37.972616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:37.972616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] PATH_INFO: `/v3/users/a246652716f34f50b589eb4e4c15a9a2` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:37.973225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a246652716f34f50b589eb4e4c15a9a2)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:37.974987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:38.200235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a246652716f34f50b589eb4e4c15a9a2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:38.207250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a246652716f34f50b589eb4e4c15a9a2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:38.207991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a246652716f34f50b589eb4e4c15a9a2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:38.334938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a246652716f34f50b589eb4e4c15a9a2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:38.335558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a246652716f34f50b589eb4e4c15a9a2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:38.353875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1136/2252] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:37 2022] DELETE /identity/v3/users/a246652716f34f50b589eb4e4c15a9a2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:38.358635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3c86-bdfe-4602-988b-a6f9825bf9e1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:38.359097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3c86-bdfe-4602-988b-a6f9825bf9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:38.359214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3c86-bdfe-4602-988b-a6f9825bf9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:38.376552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e32b3c86-bdfe-4602-988b-a6f9825bf9e1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:38.377752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e32b3c86-bdfe-4602-988b-a6f9825bf9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:38.434681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1117/2253] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:38.444566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:38.446152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:38.510615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fc74a-23a7-48b4-9c31-127c30a4b1b7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:38.514204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:38.514844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:38.515122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:38.515390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:38.526215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:38.528489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5960ad-1285-4ba5-ba96-43064209448b service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:38.540393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1137/2254] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:38.738638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:38.739261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:38.739730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:38.741878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1118/2255] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 13:56:38.750137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:38.750489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:38.750785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:38.835545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:38.837658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:38.940678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1138/2256] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:38.958645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:38.960275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.020345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db2be-3e14-4305-9e84-2a329fb514af None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.025099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.026632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.027118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.027685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.039016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.041181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df70af-6ece-497d-943d-03495069b5e7 service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.053449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1119/2257] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:39.142960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:39.144455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.158574 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38338-7ff1-449f-a8d3-11413033cac8 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.163658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.164803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.165087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.165365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] PATH_INFO: `/v3/projects/4386b80d56e14e3793fbbd15987c9a07` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.167201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4386b80d56e14e3793fbbd15987c9a07)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.170207 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.256585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034da1-dffe-4edd-afcb-627c7f61f390 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.256865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034da1-dffe-4edd-afcb-627c7f61f390 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.257133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034da1-dffe-4edd-afcb-627c7f61f390 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.258715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1120/2258] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:56:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:56:39.261375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4386b80d56e14e3793fbbd15987c9a07', 'request_id': 'req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.263389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.263859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.264138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.267401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4386b80d56e14e3793fbbd15987c9a07', 'request_id': 'req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.301341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] MFA Rules not processed for user `b3e3032053704bdb8283b139a95d1817`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:39.302645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.355383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4386b80d56e14e3793fbbd15987c9a07', 'request_id': 'req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.355543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1121/2259] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:39.367834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:39.369441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] The token cache is being invalidate because project 4386b80d56e14e3793fbbd15987c9a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:39.369441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.369674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.369768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.374518 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1139/2260] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:39 2022] DELETE /identity/v3/projects/4386b80d56e14e3793fbbd15987c9a07 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:39.375345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:39.377664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.381216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4102ff-fb22-472a-98e5-28e2f6b5549c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.386365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.387673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.388017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.388296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.390865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.402262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.403921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e3ed-db3e-4339-9c6f-0f3bad976a01 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.412275 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1122/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:56:39.446761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb093b-1c2b-4ca9-aa00-b3cff76f127a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.453026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.454190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.454340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.454655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] PATH_INFO: `/v3/users/797db9fffefc471ba3f5735286b3d2f3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.455962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797db9fffefc471ba3f5735286b3d2f3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.458444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.504454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9259da-bd85-422c-adb6-11265bfb0caf None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.504823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9259da-bd85-422c-adb6-11265bfb0caf None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.505163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9259da-bd85-422c-adb6-11265bfb0caf None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.506807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1123/2262] 10.222.0.26 () {54 vars in 921 bytes} [Thu May 5 13:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 13:56:39.512863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.513155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.513435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.538548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] MFA Rules not processed for user `7140d54b537b43f588f282cd39120eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:39.540360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.611959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1124/2263] 10.222.0.26 () {58 vars in 1018 bytes} [Thu May 5 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:39.612879 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:39.614306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.627844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425cc3e-9685-4900-b336-e835e742a8c0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.632621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.633487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.633765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.634053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] PATH_INFO: `/v3/users/b90174094d9f4abc8ade1af5cc5f958c` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.635809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90174094d9f4abc8ade1af5cc5f958c)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.637744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.651434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797db9fffefc471ba3f5735286b3d2f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.658597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797db9fffefc471ba3f5735286b3d2f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.660457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797db9fffefc471ba3f5735286b3d2f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.752204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797db9fffefc471ba3f5735286b3d2f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.752833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797db9fffefc471ba3f5735286b3d2f3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.774649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1140/2264] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:39 2022] DELETE /identity/v3/users/797db9fffefc471ba3f5735286b3d2f3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:39.775498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:39.776865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.852408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90174094d9f4abc8ade1af5cc5f958c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.858965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a643a-9318-4f44-bc97-8c6dafcdbd95 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:39.863231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:39.864500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.864660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.864881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:39.865941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90174094d9f4abc8ade1af5cc5f958c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.868646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:39.870290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90174094d9f4abc8ade1af5cc5f958c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.871023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90174094d9f4abc8ade1af5cc5f958c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.944920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:39.946424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700201b-ae17-4270-87ce-b249278c99ad service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:39.958913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1141/2265] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:39.962172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90174094d9f4abc8ade1af5cc5f958c'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:39.984664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1125/2266] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:39 2022] DELETE /identity/v3/users/b90174094d9f4abc8ade1af5cc5f958c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:39.987979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:39.991653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:39.991653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.008688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:40.011066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.099160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1142/2267] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:40.148442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:40.153042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.240463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d842da-452c-40b1-9631-b601b09607d1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:40.245075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:40.245734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.246197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.246510 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.256896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:40.258539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd657dfa-e439-4a0e-bfd6-d857b370a2c1 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:40.268778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1126/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:40.372826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:40.374302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.386881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583f831-0690-44cb-910d-ace2c63abdd4 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:40.391972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:40.392844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.393125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.393400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] PATH_INFO: `/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.394653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6a2a5cc1e847f59f26f0710c02960e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:40.396663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:40.526505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6a2a5cc1e847f59f26f0710c02960e', 'request_id': 'req-098a803e-311d-41eb-b45a-e6a23265c7fa'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:40.531670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6a2a5cc1e847f59f26f0710c02960e', 'request_id': 'req-098a803e-311d-41eb-b45a-e6a23265c7fa'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:40.612729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6a2a5cc1e847f59f26f0710c02960e', 'request_id': 'req-098a803e-311d-41eb-b45a-e6a23265c7fa'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:40.625085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] The token cache is being invalidate because project bc6a2a5cc1e847f59f26f0710c02960e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:40.625437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:40.626239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-098a803e-311d-41eb-b45a-e6a23265c7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:40.628097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1143/2269] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:40 2022] DELETE /identity/v3/projects/bc6a2a5cc1e847f59f26f0710c02960e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:40.632883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.633378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.633495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.652508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:40.653715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.714450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1127/2270] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:40.722280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.722569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.722869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.741995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:40.743334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.751460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1144/2271] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:40.757192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:40.766837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8816dc-e2a7-4aa7-8ab0-498758c635f7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:40.771455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:40.772093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.772368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.772637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.773358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:40.773658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:40.775310 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:40.787151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1128/2272] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:56:40.792058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:40.801221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d34f12-9964-435e-87d8-61f8c591a56d None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:40.805919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:40.806592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.806874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.807149 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.807848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:40.809760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:40.859819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:40.861566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:40.875825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d357502-1f0c-432a-b3a1-9e42e96584b1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:40.881140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:40.881992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:40.882315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:40.882586 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] PATH_INFO: `/v3/projects/14666e334a3c47fc844be9ef7b2eca9f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:40.883762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=14666e334a3c47fc844be9ef7b2eca9f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:40.886240 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.010640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1145/2273] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:40 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:41.014949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.083997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14666e334a3c47fc844be9ef7b2eca9f', 'request_id': 'req-d31adfde-bb78-40da-a29b-08dca53affeb'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.094349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14666e334a3c47fc844be9ef7b2eca9f', 'request_id': 'req-d31adfde-bb78-40da-a29b-08dca53affeb'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.126162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd460-61dd-4225-8ffc-4a24a290cc74 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.196164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14666e334a3c47fc844be9ef7b2eca9f', 'request_id': 'req-d31adfde-bb78-40da-a29b-08dca53affeb'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.214916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] The token cache is being invalidate because project 14666e334a3c47fc844be9ef7b2eca9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:41.215206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.216295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.220972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1129/2274] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:40 2022] DELETE /identity/v3/projects/14666e334a3c47fc844be9ef7b2eca9f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:41.224938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.226555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:41.231946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.232834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.233270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.233734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.234797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.236927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.241218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adfde-bb78-40da-a29b-08dca53affeb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.249047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.250690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.250690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.250909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] PATH_INFO: `/v3/users/fe4dacab7d294287b6786c3760d35e60` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.252092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4dacab7d294287b6786c3760d35e60)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.254096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.344302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1146/2275] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:41 2022] POST /identity/v3/users => generated 288 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:41.348161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.350053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:41.364181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947fd7-9637-4bcf-9b5b-78894557749b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.371349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.372098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.372453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.372806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.373623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.375337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.392237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1147/2276] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:41.396240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.407581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bdf4-8d91-435e-b0ae-1c21356e5313 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.415077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.416227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.416544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.424193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.424193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.424193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.430977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1148/2277] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:41.435589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.445669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12e46f-2797-40a3-a3ba-a430f8f06e54 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.451211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.452536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.452536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.453105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] PATH_INFO: `/v3/projects/67e960ad3921475890bbcddcdf6cd437/users/0b5ae155195a47efaeb9b3bbc0f09b76/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.472665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e960ad3921475890bbcddcdf6cd437, user_id=0b5ae155195a47efaeb9b3bbc0f09b76, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.476134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c4741-6264-4429-931e-04b46498f9c4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.488602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4dacab7d294287b6786c3760d35e60'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.497332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4dacab7d294287b6786c3760d35e60'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.498088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4dacab7d294287b6786c3760d35e60'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.498843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4dacab7d294287b6786c3760d35e60'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.564001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1149/2278] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:41 2022] PUT /identity/v3/projects/67e960ad3921475890bbcddcdf6cd437/users/0b5ae155195a47efaeb9b3bbc0f09b76/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:41.575602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.575889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.576164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.586142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4dacab7d294287b6786c3760d35e60'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:41.604169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] MFA Rules not processed for user `0b5ae155195a47efaeb9b3bbc0f09b76`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:41.605449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:41.616106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1130/2279] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:41 2022] DELETE /identity/v3/users/fe4dacab7d294287b6786c3760d35e60 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:41.677289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1150/2280] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:41.689115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:41.691182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:41.755469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265530ad-0f21-4fcd-905b-37d08ca0986e admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:41.759196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:41.760362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:41.760627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:41.760898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:41.816324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:41.817793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:41.828225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1131/2281] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:42.036928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:42.038514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:42.104851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e7ba7-68d8-406e-a20c-c70b3ed5c90e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:42.163536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:42.164398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:42.164708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:42.165161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] PATH_INFO: `/v3/projects/97b3b47008fc4fa5babe298b95261615` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:42.167619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b3b47008fc4fa5babe298b95261615)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:42.168883 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:42.317388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b3b47008fc4fa5babe298b95261615', 'request_id': 'req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.323502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b3b47008fc4fa5babe298b95261615', 'request_id': 'req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.429644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b3b47008fc4fa5babe298b95261615', 'request_id': 'req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.443122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] The token cache is being invalidate because project 97b3b47008fc4fa5babe298b95261615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:42.443326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.444028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.445605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1151/2282] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:42 2022] DELETE /identity/v3/projects/97b3b47008fc4fa5babe298b95261615 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:42.450263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:42.465729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055679-8830-4643-8b84-349edc54ce4d service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:42.524206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:42.525068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:42.525337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:42.525607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] PATH_INFO: `/v3/users/7aaf95b6cadd422a9c80c8a91bb6a45e` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:42.526811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaf95b6cadd422a9c80c8a91bb6a45e)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:42.528706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:42.742868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaf95b6cadd422a9c80c8a91bb6a45e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.750044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaf95b6cadd422a9c80c8a91bb6a45e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.750726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaf95b6cadd422a9c80c8a91bb6a45e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.751334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaf95b6cadd422a9c80c8a91bb6a45e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.921504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d01005e7-85ad-439d-9917-afbc525b59fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaf95b6cadd422a9c80c8a91bb6a45e'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:42.939247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1132/2283] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:42 2022] DELETE /identity/v3/users/7aaf95b6cadd422a9c80c8a91bb6a45e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:43.717249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:43.719032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:43.734979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6a7db-4dfb-4be6-82c5-d14cd8f25ad5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:43.804877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:43.805997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:43.806313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:43.806587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] PATH_INFO: `/v3/projects/51df9015369c4f04a88fbbb5577a5ec3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:43.808708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51df9015369c4f04a88fbbb5577a5ec3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:43.811516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:43.915133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51df9015369c4f04a88fbbb5577a5ec3', 'request_id': 'req-111ed012-6feb-43f4-90ff-4514cc88e884'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:43.921481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51df9015369c4f04a88fbbb5577a5ec3', 'request_id': 'req-111ed012-6feb-43f4-90ff-4514cc88e884'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:43.991656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51df9015369c4f04a88fbbb5577a5ec3', 'request_id': 'req-111ed012-6feb-43f4-90ff-4514cc88e884'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:44.006053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] The token cache is being invalidate because project 51df9015369c4f04a88fbbb5577a5ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:44.006053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:44.006728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-111ed012-6feb-43f4-90ff-4514cc88e884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:44.009637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1152/2284] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:43 2022] DELETE /identity/v3/projects/51df9015369c4f04a88fbbb5577a5ec3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:44.015524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.015963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.016079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.035252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:44.036353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:44.097247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1133/2285] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:44.105784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.106098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.106376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.125906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:44.127260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:44.135329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1153/2286] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:44.139558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.159273 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd717-f142-454e-846f-17e5c38ea19a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.163940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.170819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.180090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1134/2287] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 13:56:44.185153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.198916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0e52c-7010-4645-aa78-70b13e1f15bd None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.206167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.207315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.207821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.208592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.209928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.214318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.368846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1154/2288] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:44.370074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.380679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e940-7e1c-4d62-af28-c4ff2b712d9a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.449361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.450067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.450512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.450789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.451500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.453590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.530243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1135/2289] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:44.533796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.544595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e5ca-f4e4-4725-ad0e-b9493d0cb951 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.549291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.549942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.550250 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.550516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.551278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.552904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.563820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1155/2290] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:44.567784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.577654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d49cd7-46ea-47c8-8a0e-52ab6d20e847 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.582622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.583569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.583873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.584177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.584944 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.586547 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd19f2-872c-421b-8e26-8c8dda1c833f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.596422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1136/2291] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:44.600441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.610873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba31b55-278f-4009-8c40-57ceae41b1f2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.615515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.616377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.616658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.616932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] PATH_INFO: `/v3/projects/6f1bcda9917e433d93538c41cbad6164/users/5ae8ce7f9b114d7d82daa30ee0fd19ce/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.631855 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1bcda9917e433d93538c41cbad6164, user_id=5ae8ce7f9b114d7d82daa30ee0fd19ce, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.634540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:44.694589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1156/2292] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:44 2022] PUT /identity/v3/projects/6f1bcda9917e433d93538c41cbad6164/users/5ae8ce7f9b114d7d82daa30ee0fd19ce/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:44.706700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.706982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.707258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.734311 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] MFA Rules not processed for user `5ae8ce7f9b114d7d82daa30ee0fd19ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:44.735531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:44.797369 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1137/2293] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:44.801725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:44.864173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a34a-7f4e-4012-86fa-2a444ebf7254 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:44.869014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:44.870371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:44.870650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:44.870927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:44.871621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:44.873551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0f889-1058-4231-bb87-054e3546f3b7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.001848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1157/2294] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:44 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:45.003058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.013850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d17a4-8fb6-459e-a27a-0c3c9dc24ca6 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.079004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.079681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.079958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.080230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.081335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.083619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.140689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.141181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.143904 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.162029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:45.163336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:45.222829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1158/2295] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:45.223088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1138/2296] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:45 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:45.227217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.238861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.240057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc19c-ff81-4610-983f-5d50f5b77a28 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.241870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:45.246076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.246934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.247216 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.247486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.256370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.256370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.260783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1159/2297] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:45.264638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.275301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62636621-866f-48a9-a44e-6882ef088f25 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.281554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.282480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.282759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.283031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] PATH_INFO: `/v3/projects/777c18cedf354d27975d4ceb1745e89b/users/78e8ddd263a14d3489443885bb4b6bc7/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.299766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777c18cedf354d27975d4ceb1745e89b, user_id=78e8ddd263a14d3489443885bb4b6bc7, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.302598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.318387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01ef7-f939-45bb-8664-f8207762f42f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.323245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.323894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.324174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.324454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.332834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.334674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.345077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1139/2298] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:56:45.388374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1160/2299] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:45 2022] PUT /identity/v3/projects/777c18cedf354d27975d4ceb1745e89b/users/78e8ddd263a14d3489443885bb4b6bc7/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 13:56:45.392159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.403237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b068f01-4cbb-4268-bd7d-b837340eb912 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.461767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.462472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.462757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.463639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.464505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.466125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28089-52e0-441b-b2b0-068ccb9c3625 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.477469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1140/2300] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:45.481784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.492686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb89c3-f9ee-4258-8413-4f29f750b4a1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.497153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.498071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.498373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.498612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] PATH_INFO: `/v3/projects/777c18cedf354d27975d4ceb1745e89b/users/78e8ddd263a14d3489443885bb4b6bc7/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.500597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=777c18cedf354d27975d4ceb1745e89b, user_id=78e8ddd263a14d3489443885bb4b6bc7, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.503254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.515217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1161/2301] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:45 2022] PUT /identity/v3/projects/777c18cedf354d27975d4ceb1745e89b/users/78e8ddd263a14d3489443885bb4b6bc7/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:45.526277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.526639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.527098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.567626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] MFA Rules not processed for user `78e8ddd263a14d3489443885bb4b6bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:45.568421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:45.681538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1141/2302] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:45.691156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:45.693044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:45.798356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02f3a1-a6b8-42cb-889b-44b260fb0a3c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:45.806633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:45.807404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:45.807648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:45.807922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:45.818053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:45.819594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9070c5-1464-4b85-b2dd-9f841850e8a9 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:45.830554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1162/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:45.980873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:46.064165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3531-2bad-4927-abe9-39f701ced73f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:46.068810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:46.074968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:46.076387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:46.076387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] PATH_INFO: `/v3/users/5ae8ce7f9b114d7d82daa30ee0fd19ce` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:46.076855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae8ce7f9b114d7d82daa30ee0fd19ce)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:46.082520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:46.280141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae8ce7f9b114d7d82daa30ee0fd19ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:46.294559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae8ce7f9b114d7d82daa30ee0fd19ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:46.295647 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae8ce7f9b114d7d82daa30ee0fd19ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:46.296716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae8ce7f9b114d7d82daa30ee0fd19ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:46.378125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae8ce7f9b114d7d82daa30ee0fd19ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:46.400453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1142/2304] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:45 2022] DELETE /identity/v3/users/5ae8ce7f9b114d7d82daa30ee0fd19ce => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:46.405196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:46.405551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:46.405896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:46.423064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:46.428937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:46.538174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1163/2305] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:46.545228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:46.546736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:46.614660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92b16-cff7-460c-8061-204f47b943a7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:46.618622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:46.620090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:46.620554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:46.620949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:46.631662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:46.633518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:46.645534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1143/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:47.453755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:47.459292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:47.488052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf908a69-4716-4470-9532-4a8184be92b6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:47.494167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:47.496061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:47.496826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:47.497504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] PATH_INFO: `/v3/projects/6f1bcda9917e433d93538c41cbad6164` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:47.499158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1bcda9917e433d93538c41cbad6164)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:47.506851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:47.641554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1bcda9917e433d93538c41cbad6164', 'request_id': 'req-4a5538fd-4132-42d2-8b22-1f547313b732'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:47.665375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1bcda9917e433d93538c41cbad6164', 'request_id': 'req-4a5538fd-4132-42d2-8b22-1f547313b732'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:47.742877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1bcda9917e433d93538c41cbad6164', 'request_id': 'req-4a5538fd-4132-42d2-8b22-1f547313b732'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:47.770382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] The token cache is being invalidate because project 6f1bcda9917e433d93538c41cbad6164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:47.770937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:47.773326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:47.781031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1164/2307] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:47 2022] DELETE /identity/v3/projects/6f1bcda9917e433d93538c41cbad6164 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:47.781857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:47.796820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521b9b-5789-43e9-8ef9-649a668a1aad service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:47.900173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:47.901733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:47.906340 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:47.906841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] PATH_INFO: `/v3/users/78e8ddd263a14d3489443885bb4b6bc7` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:47.909383 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e8ddd263a14d3489443885bb4b6bc7)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:47.912262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:48.162387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e8ddd263a14d3489443885bb4b6bc7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:48.162387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e8ddd263a14d3489443885bb4b6bc7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:48.162387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e8ddd263a14d3489443885bb4b6bc7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:48.162387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e8ddd263a14d3489443885bb4b6bc7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:48.255041 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b58b9b51-8b6e-468f-b7d1-874a46cc511a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e8ddd263a14d3489443885bb4b6bc7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:48.279784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1144/2308] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:47 2022] DELETE /identity/v3/users/78e8ddd263a14d3489443885bb4b6bc7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:48.747774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:48.749244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:48.785954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5538fd-4132-42d2-8b22-1f547313b732 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:48.883247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:48.884134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:48.884409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:48.884676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] PATH_INFO: `/v3/projects/777c18cedf354d27975d4ceb1745e89b` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:48.889104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777c18cedf354d27975d4ceb1745e89b)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:48.891235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.086054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777c18cedf354d27975d4ceb1745e89b', 'request_id': 'req-b8a629b8-2f7c-43d1-b716-f37016701903'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:49.109841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777c18cedf354d27975d4ceb1745e89b', 'request_id': 'req-b8a629b8-2f7c-43d1-b716-f37016701903'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:49.207391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777c18cedf354d27975d4ceb1745e89b', 'request_id': 'req-b8a629b8-2f7c-43d1-b716-f37016701903'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:49.224897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] The token cache is being invalidate because project 777c18cedf354d27975d4ceb1745e89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:49.225144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:49.225967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b8a629b8-2f7c-43d1-b716-f37016701903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:49.227779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1165/2309] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:48 2022] DELETE /identity/v3/projects/777c18cedf354d27975d4ceb1745e89b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:49.232880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.233475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.233475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.267745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:49.269580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:49.367252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1145/2310] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:56:49.375733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.376023 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.376320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.395553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:49.396773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:49.411978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1166/2311] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:49.416428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.426200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa829ba5-870d-40ed-a232-5fed0716a0c2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.430777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.431431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.432244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.432513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.433248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:49.433552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.435336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.453436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1146/2312] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:49.454531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.469704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52002be0-5c16-4922-9879-9901a3fccd67 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.474744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.475520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.475870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.476265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.476984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.479089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.582782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1167/2313] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:49 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:56:49.587174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.597862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8d4d-eca5-44b3-bc23-fc0970a877a0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.663082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.663752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.664038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.664294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.665009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.667001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.766636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1147/2314] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:49 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:49.771382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.784502 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4d61f-a6ee-456e-8c5a-56cff8973c3d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.788991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.789675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.789950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.790292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.791018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.793133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.803516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1168/2315] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:49.808071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.825512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4442877-0d72-45e3-8dec-11f1fcbf72ff admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.830000 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.830895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.831315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.831711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.832751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.835100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b31a-b53e-4f55-a26e-f76bb0f2706f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.856220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1148/2316] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:56:49.860393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:49.874253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7e838-9ed2-4344-ad5c-8a7abd981574 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:49.878956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:49.879848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.880128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.880400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] PATH_INFO: `/v3/projects/d96f44085ffe434a92591317f3c69ea8/users/425abbcd96b844aa858d110dbdcc8c24/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:49.898553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96f44085ffe434a92591317f3c69ea8, user_id=425abbcd96b844aa858d110dbdcc8c24, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:49.906473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:49.975900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1169/2317] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:49 2022] PUT /identity/v3/projects/d96f44085ffe434a92591317f3c69ea8/users/425abbcd96b844aa858d110dbdcc8c24/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:49.987812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:49.988172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:49.988604 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:50.033351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] MFA Rules not processed for user `425abbcd96b844aa858d110dbdcc8c24`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:50.034680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:50.114510 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1149/2318] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:50.125756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:50.128349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:50.285799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc0048-0d8a-4b02-b307-919e495204ca admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:50.301459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:50.302160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:50.302444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:50.302724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:50.322457 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:50.323936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0d1c-7808-4753-894c-1c4d5d7b873e service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:50.335308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1170/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:56.453449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:56.455191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:56.526522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d817-1695-4256-a0d5-b9039dd5c198 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:56.531152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:56.533233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:56.533233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:56.533233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] PATH_INFO: `/v3/users/0b5ae155195a47efaeb9b3bbc0f09b76` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:56.533894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5ae155195a47efaeb9b3bbc0f09b76)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:56.535843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:56.722928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5ae155195a47efaeb9b3bbc0f09b76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:56.731537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5ae155195a47efaeb9b3bbc0f09b76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:56.732360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5ae155195a47efaeb9b3bbc0f09b76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:56.733054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5ae155195a47efaeb9b3bbc0f09b76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:56.809724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5ae155195a47efaeb9b3bbc0f09b76'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:56.835836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1150/2320] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:56:56 2022] DELETE /identity/v3/users/0b5ae155195a47efaeb9b3bbc0f09b76 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:56.839546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:56.842661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:56.842993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:56.881195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:56.882721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:56.964224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1171/2321] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:56.979652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:56.979652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:57.042818 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd257d-fd2e-43df-83b8-673cdc6b3a6a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:57.046651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:57.047308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.047585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.047854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.056585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:57.058545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15982d-eb0f-4b2e-a005-4aaa58b413c9 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:57.068091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1151/2322] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:56:57.494190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:57.496240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:57.508120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97849ab9-f3d1-4b03-a6ef-950ca6ad78a6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:57.512820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:57.513678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.513960 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.514274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] PATH_INFO: `/v3/projects/67e960ad3921475890bbcddcdf6cd437` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.515563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e960ad3921475890bbcddcdf6cd437)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:57.517534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:57.658544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e960ad3921475890bbcddcdf6cd437', 'request_id': 'req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:57.664690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e960ad3921475890bbcddcdf6cd437', 'request_id': 'req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:57.760777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e960ad3921475890bbcddcdf6cd437', 'request_id': 'req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:57.772570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] The token cache is being invalidate because project 67e960ad3921475890bbcddcdf6cd437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:56:57.772994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:57.773886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-94c02ffc-9e65-4cc9-a3c3-2e6b4cc6aa91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:56:57.775836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1172/2323] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:56:57 2022] DELETE /identity/v3/projects/67e960ad3921475890bbcddcdf6cd437 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:57.780674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.781588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.782077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.800755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:57.801947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:57.880200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1152/2324] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:57.888454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.888919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.891568 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.910336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:57.911550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:57.920371 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1173/2325] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:57.924526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:57.934938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc1f9c-843c-444c-92c3-123c4a2ecdd8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:57.939668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:57.940458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.940843 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.941177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.941971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:56:57.942378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:57.944031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:57.956502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1153/2326] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:56:57.961097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:57.970995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6183b-a2c9-4c0e-b8bc-e10f47a3c340 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:57.975844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:57.976497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:57.976771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:57.977039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:57.977727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:57.980258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.067512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1174/2327] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:56:57 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:58.071620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:58.082234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36d09-91e6-4475-8ba9-c6ae357cf505 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:58.140234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:58.140893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.141167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.141438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.142137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:58.144042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.247226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1154/2328] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:56:58 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:56:58.251000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:58.261922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6051-fa52-4681-b60d-3279052ebac7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:58.267013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:58.267380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.267658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.267928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.268647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:58.270381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.281406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1175/2329] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:58.286973 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:58.297103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b1e29-ca70-467a-8b31-1fbc0a05548c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:58.301754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:58.302442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.302725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.302999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.303728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:58.305318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b919072-26c7-4e48-a732-ae853d32b626 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.315328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1155/2330] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:56:58.319408 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:58.329735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65fa5-6233-4412-9fd8-9a54a39936a3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:58.334647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:58.335513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.335791 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.336064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] PATH_INFO: `/v3/projects/d2c9372df138414191186d3c950d2e23/users/a07bae627665426fba032d7757685fd1/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.350496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c9372df138414191186d3c950d2e23, user_id=a07bae627665426fba032d7757685fd1, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:58.353137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.420082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1176/2331] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:56:58 2022] PUT /identity/v3/projects/d2c9372df138414191186d3c950d2e23/users/a07bae627665426fba032d7757685fd1/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:56:58.425223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aafb5-a432-4c5a-9e53-d297b5d7710e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.425512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aafb5-a432-4c5a-9e53-d297b5d7710e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.425790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aafb5-a432-4c5a-9e53-d297b5d7710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.443841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8d5aafb5-a432-4c5a-9e53-d297b5d7710e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:56:58.445025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8d5aafb5-a432-4c5a-9e53-d297b5d7710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:58.501530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1156/2332] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:56:58.511445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:56:58.513109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:56:58.567241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c88-2795-4bc9-b003-bf6544367ee9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:56:58.570802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:56:58.571438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:56:58.571717 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:56:58.571990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:56:58.581351 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:56:58.582795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:56:58.592209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1177/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:57:05.090806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.091766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.092046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.126551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] MFA Rules not processed for user `a07bae627665426fba032d7757685fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:05.128526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:05.210879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.217566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1157/2334] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:05.221527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3f87-41c0-4909-982a-4aa66df7b143 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.226987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.227861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.228296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.228771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.229620 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.231951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.391916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1178/2335] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 13:57:05.396590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.418632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d04f-508b-4cb2-984c-4772a4b47074 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.510797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.511584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.511873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.512155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.512864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.514901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.626682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1158/2336] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:57:05 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:57:05.630621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.641281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc24-c092-4e53-9b63-59ea89561327 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.645866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.646554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.646905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.647182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.647909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.649511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.660419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1179/2337] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:05.664582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.675243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688b57-c46d-45f1-a7f1-433e5121ad73 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.680154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.682312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.682312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.682312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] PATH_INFO: `/v3/projects/7f9474c2751047eeab39b5708dfa298b/users/f6baac3b26ef47db94dcdc97f713e67a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.696648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9474c2751047eeab39b5708dfa298b, user_id=f6baac3b26ef47db94dcdc97f713e67a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.699912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.775038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1159/2338] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:57:05 2022] PUT /identity/v3/projects/7f9474c2751047eeab39b5708dfa298b/users/f6baac3b26ef47db94dcdc97f713e67a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:05.779784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.790496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c5c9-73b1-46fe-befa-498d75150999 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.847159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.847825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.848108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.848384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.849120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.850774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7296c-3b64-4cef-9b92-df8637a839f9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.861612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1180/2339] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:05.865769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:05.879595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1097a-3325-4499-b8fd-5723897641dc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:05.891410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:05.892869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:05.893247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:05.893697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] PATH_INFO: `/v3/projects/7f9474c2751047eeab39b5708dfa298b/users/f6baac3b26ef47db94dcdc97f713e67a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:05.895959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9474c2751047eeab39b5708dfa298b, user_id=f6baac3b26ef47db94dcdc97f713e67a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:05.898803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:05.918663 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1160/2340] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:57:05 2022] PUT /identity/v3/projects/7f9474c2751047eeab39b5708dfa298b/users/f6baac3b26ef47db94dcdc97f713e67a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:12.338332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd46df-1752-413d-8d5a-531b8a4947ff None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:12.338867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd46df-1752-413d-8d5a-531b8a4947ff None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:12.338867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd46df-1752-413d-8d5a-531b8a4947ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:12.368990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1acd46df-1752-413d-8d5a-531b8a4947ff None None] MFA Rules not processed for user `f6baac3b26ef47db94dcdc97f713e67a`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:12.371048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1acd46df-1752-413d-8d5a-531b8a4947ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:12.477459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1181/2341] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:12.491559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:12.495319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:12.609561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172de6e-1f8f-4d35-be18-31686ab1d9ca admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:12.616426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:12.617155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:12.617506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:12.617875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:12.692427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:12.693909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:12.706168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1161/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:57:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:57:13.005349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c60-0e1d-493d-8783-d114d357c98c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:13.006048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c60-0e1d-493d-8783-d114d357c98c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:13.006374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c60-0e1d-493d-8783-d114d357c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:13.060364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-232c4c60-0e1d-493d-8783-d114d357c98c None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:13.061588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-232c4c60-0e1d-493d-8783-d114d357c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:13.129101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1182/2343] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:57:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:13.151437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:13.152823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:13.242398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c7f7e-0ed8-4851-9f0e-858808422a87 service glance] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:13.247440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:13.248080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:13.248365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:13.248639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:13.256668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:13.258323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:13.266808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1162/2344] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:57:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:57:13.771496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:13.771996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:13.772096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:13.792974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:13.794377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:13.803881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1183/2345] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:57:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:13.821888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:13.833584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6d8b6-7142-40b7-8f44-e76bcb4c01c4 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:13.841988 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:13.842840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:13.843217 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:13.843591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:13.853209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:13.855570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1005-c63b-49b0-a4a2-b6206ce2a963 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:13.870479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1163/2346] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:57:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:57:17.376755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:17.378262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:17.486600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906c03-e3a3-47a1-8d34-ab5a94249ab4 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:17.503708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:17.505636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:17.506258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:17.506687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] PATH_INFO: `/v3/users/425abbcd96b844aa858d110dbdcc8c24` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:17.512838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425abbcd96b844aa858d110dbdcc8c24)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:17.514683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:18.119449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425abbcd96b844aa858d110dbdcc8c24'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:18.127014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425abbcd96b844aa858d110dbdcc8c24'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:18.130615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425abbcd96b844aa858d110dbdcc8c24'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:18.270680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425abbcd96b844aa858d110dbdcc8c24'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:18.271353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425abbcd96b844aa858d110dbdcc8c24'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:18.329566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1184/2347] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:57:17 2022] DELETE /identity/v3/users/425abbcd96b844aa858d110dbdcc8c24 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:18.331948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:18.332560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:18.332560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:18.358114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:18.359727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:18.420985 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1164/2348] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:18.432372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:18.434513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:18.509291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904320e-2477-4d49-9d02-c15235d4d0c1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:18.513760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:18.514627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:18.515275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:18.515275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:18.525576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:18.527325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:18.545456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1185/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:57:18.754960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:18.761447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:18.963202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b1cd1-3cc3-44e9-b037-3179a2928d17 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:18.984290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:18.985869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:18.986769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:18.987191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:18.989281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:19.008783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:19.011577 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf9549-3f9b-4cc5-89f9-0cae9fc54a12 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:19.047407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1165/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:57:19.726088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:19.728283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:19.779857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d614ec-5489-4f43-897e-85673f62d5dc service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:19.785432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:19.786934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:19.791828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:19.791828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] PATH_INFO: `/v3/projects/d96f44085ffe434a92591317f3c69ea8` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:19.791828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96f44085ffe434a92591317f3c69ea8)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:19.792390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:19.970318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96f44085ffe434a92591317f3c69ea8', 'request_id': 'req-058f44e8-4b94-469f-aac2-e178b03b7806'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:19.983296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96f44085ffe434a92591317f3c69ea8', 'request_id': 'req-058f44e8-4b94-469f-aac2-e178b03b7806'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:20.083269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96f44085ffe434a92591317f3c69ea8', 'request_id': 'req-058f44e8-4b94-469f-aac2-e178b03b7806'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:20.107276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] The token cache is being invalidate because project d96f44085ffe434a92591317f3c69ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:57:20.110095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:20.112019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-058f44e8-4b94-469f-aac2-e178b03b7806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:20.122796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1186/2351] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:57:19 2022] DELETE /identity/v3/projects/d96f44085ffe434a92591317f3c69ea8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:20.127915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:20.128990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:20.129426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:20.175238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:20.185386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:20.385762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1166/2352] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:20.393652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:20.394550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:20.394985 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:20.454928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:20.456354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:20.475920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1187/2353] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:20.480390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:20.494049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf5309-56f5-4b33-bc64-c7efdc31736d None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:20.517613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:20.519028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:20.519487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:20.520234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:20.521787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:57:20.523736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:20.527302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:20.560969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1167/2354] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:57:20.565545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:20.581665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1838-ca63-4dab-8ba9-348dbe429aaa None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:20.594337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:20.594943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:20.595222 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:20.595495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:20.596200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:20.598167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:20.764403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1188/2355] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:57:20 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:57:20.765800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:20.811755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6af0b-fdf2-4e98-ad94-02156eee21cf admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:20.946920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:20.947675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:20.947938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:20.948243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:20.948926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:20.952837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:21.053005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1168/2356] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:57:20 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:57:21.054451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:21.073659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff8d6-70d9-4adc-b8a0-44ac75d9dfed admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:21.100835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:21.101522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:21.101805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:21.102104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:21.102843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:21.106929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:21.143973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1189/2357] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:21.145561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:21.167982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e9b97-c240-4f76-bae9-eae43ff7da88 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:21.178781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:21.179645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:21.180093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:21.180534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:21.181442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:21.183304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db82eb-3c5c-4619-8c53-6ee5f1b1e76e admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:21.194787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1169/2358] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:21.202084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:21.220224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00b3f-ed65-4ec6-aad4-3624a1c00be5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:21.225310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:21.226354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:21.226765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:21.227156 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] PATH_INFO: `/v3/projects/e8177484577e4db78815bbdc3561f3a9/users/70bfd6b236d14e87a24ad07c1bc8e4da/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:21.255181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8177484577e4db78815bbdc3561f3a9, user_id=70bfd6b236d14e87a24ad07c1bc8e4da, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:21.258134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862de3-f390-47b3-b023-4b60adf5db0d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:21.351277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:21.352021 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:21.352555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:21.355097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1190/2359] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:57:21 2022] PUT /identity/v3/projects/e8177484577e4db78815bbdc3561f3a9/users/70bfd6b236d14e87a24ad07c1bc8e4da/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:21.400223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] MFA Rules not processed for user `70bfd6b236d14e87a24ad07c1bc8e4da`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:21.401955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:21.555414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1170/2360] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:27.979499 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e863b3-b2ba-4478-8a59-e0e501ac5ee6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:27.986414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e863b3-b2ba-4478-8a59-e0e501ac5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:27.986414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e863b3-b2ba-4478-8a59-e0e501ac5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:28.009899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-27e863b3-b2ba-4478-8a59-e0e501ac5ee6 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:28.011787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-27e863b3-b2ba-4478-8a59-e0e501ac5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:28.090779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1191/2361] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:28.114492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:28.115956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:28.200405 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822d3dd-54ed-490f-a35e-b268dfcc4416 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:28.205947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:28.206852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:28.207207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:28.207530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:28.217594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:28.220989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:28.229155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1171/2362] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:57:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:57:28.329442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273775-79f5-4181-9d53-bedecd82db06 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:28.331607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273775-79f5-4181-9d53-bedecd82db06 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:28.331607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273775-79f5-4181-9d53-bedecd82db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:28.351929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e8273775-79f5-4181-9d53-bedecd82db06 None None] MFA Rules not processed for user `a07bae627665426fba032d7757685fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:28.355210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e8273775-79f5-4181-9d53-bedecd82db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:28.416205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1192/2363] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:29.929326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:29.930722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:30.028609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e45e5-77c1-4f14-8cf7-1c417ca5cc37 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:30.032335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:30.033072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:30.033347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:30.033620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:30.044937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:30.046638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:30.055975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1172/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:57:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:57:36.016548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0002356-e7c8-4c1c-94f8-62112aabee41 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:36.017081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0002356-e7c8-4c1c-94f8-62112aabee41 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:36.017167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0002356-e7c8-4c1c-94f8-62112aabee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:36.035588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c0002356-e7c8-4c1c-94f8-62112aabee41 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:36.036800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c0002356-e7c8-4c1c-94f8-62112aabee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:36.044046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1193/2365] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:36.057288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:36.069689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1b82-a694-435e-8d82-75de64cc8dca service glance] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:36.075323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:36.075980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:36.076263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:36.076539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:36.085622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:36.087260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:36.096642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1173/2366] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 13:57:43.817802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:43.818723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:43.818723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:43.843014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:43.844589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:43.853054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1194/2367] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 13:57:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:43.868595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:43.883319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7757d-dcbd-4c28-8da5-ab7ad1f07014 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:43.898292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:43.898964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:43.899417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:43.899851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:43.913118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:43.914755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:43.935160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1174/2368] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 13:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 13:57:47.237802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:47.239296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:47.303186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709a8e6-179f-41db-8c98-56286cecc643 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:47.308315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:47.309180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:47.309578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:47.309867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] PATH_INFO: `/v3/users/17669504fd1b4ff6a312f73e4cce67d9` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:47.311206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17669504fd1b4ff6a312f73e4cce67d9)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:47.313106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:47.496543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17669504fd1b4ff6a312f73e4cce67d9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:47.503755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17669504fd1b4ff6a312f73e4cce67d9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:47.506910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17669504fd1b4ff6a312f73e4cce67d9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:47.595921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17669504fd1b4ff6a312f73e4cce67d9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:47.596585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-da401741-66b4-46c9-9c61-74360ce2ff63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17669504fd1b4ff6a312f73e4cce67d9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:47.614939 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1195/2369] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:57:47 2022] DELETE /identity/v3/users/17669504fd1b4ff6a312f73e4cce67d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:47.890897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:47.902959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121006-ec8c-453d-aa72-c5e0fb69f8d8 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:47.980188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:47.981500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:47.981775 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:47.982081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] PATH_INFO: `/v3/projects/c985c8f8f35d402bb2f0b438aa801575` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:47.984140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c985c8f8f35d402bb2f0b438aa801575)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:47.986218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.090274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c985c8f8f35d402bb2f0b438aa801575', 'request_id': 'req-6f38a100-16d6-4e3a-ad30-197cae3a8b67'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:48.102949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c985c8f8f35d402bb2f0b438aa801575', 'request_id': 'req-6f38a100-16d6-4e3a-ad30-197cae3a8b67'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:48.167602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c985c8f8f35d402bb2f0b438aa801575', 'request_id': 'req-6f38a100-16d6-4e3a-ad30-197cae3a8b67'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:48.179836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] The token cache is being invalidate because project c985c8f8f35d402bb2f0b438aa801575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:57:48.180123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:48.180768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6f38a100-16d6-4e3a-ad30-197cae3a8b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:57:48.185754 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1175/2370] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:57:47 2022] DELETE /identity/v3/projects/c985c8f8f35d402bb2f0b438aa801575 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:48.187563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.187873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.188143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.206628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:48.208043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:48.286670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1196/2371] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:48.288457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.288799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.289132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.313905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:48.313905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:48.325108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1176/2372] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 13:57:48.326948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.337129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162caae1-a32f-4998-bdbb-dfbc91edad94 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.342754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.343413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.343711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.343975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.344706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:57:48.345013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.347115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.362119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1197/2373] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:57:48.366407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.375805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccb0b0-7a49-4a7e-a562-8db4dc961ce1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.380495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.381147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.381427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.381703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.382450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.384350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.460688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1177/2374] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:57:48 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:57:48.465654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.476278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb542b6d-68cf-4173-b9c3-83611c84653f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.549982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.550733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.551012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.551282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.551968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.553866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.676049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1198/2375] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:57:48 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:57:48.680134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.690167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63122f11-fdaf-446e-9c61-af0ff27579b6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.694926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.695715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.696093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.696462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.697454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.699211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.710197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1178/2376] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:48.714922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.724690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e779-5b97-4ed3-96a8-77b742768205 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.730446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.737747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.737747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.737747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.737747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.737747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02632937-315f-4c18-b8fa-2439c98f64f1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.743852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1199/2377] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:57:48.748528 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.758408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfcfd1-19ef-4e30-afce-09f7e47b8eb9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:48.763471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:48.764351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.764634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.764912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] PATH_INFO: `/v3/projects/026c00e65f4d4fae9e24703db79799fc/users/486b7896652245af90028eeba923d3e3/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.779325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=026c00e65f4d4fae9e24703db79799fc, user_id=486b7896652245af90028eeba923d3e3, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:48.781980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:48.854610 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1179/2378] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:57:48 2022] PUT /identity/v3/projects/026c00e65f4d4fae9e24703db79799fc/users/486b7896652245af90028eeba923d3e3/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:57:48.865076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:48.865366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:48.865641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:48.892936 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] MFA Rules not processed for user `486b7896652245af90028eeba923d3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:57:48.894145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:48.955048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1200/2379] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:57:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:57:48.966934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:57:48.968569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:57:49.023438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89634b5-8133-4949-88a6-5bca02c372bc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:57:49.026960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:57:49.027583 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:57:49.027857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:57:49.028119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:57:49.036068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:57:49.037474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41c7f-bba8-412d-b51a-f093dc614ed7 service glance] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:57:49.046486 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1180/2380] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:57:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:58:03.173245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:03.174696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:03.239666 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed623-2fad-4048-bf7d-bd1edfb8e42b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:03.244160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:03.245033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:03.245313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:03.245587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] PATH_INFO: `/v3/users/70bfd6b236d14e87a24ad07c1bc8e4da` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:03.247045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bfd6b236d14e87a24ad07c1bc8e4da)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:03.249273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:03.426730 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bfd6b236d14e87a24ad07c1bc8e4da'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:03.433478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bfd6b236d14e87a24ad07c1bc8e4da'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:03.434372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bfd6b236d14e87a24ad07c1bc8e4da'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:03.527213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bfd6b236d14e87a24ad07c1bc8e4da'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:03.528516 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bfd6b236d14e87a24ad07c1bc8e4da'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:03.546550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1201/2381] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:58:03 2022] DELETE /identity/v3/users/70bfd6b236d14e87a24ad07c1bc8e4da => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:58:03.551016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:03.551523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:03.551620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:03.569681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:03.570939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:03.632262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1181/2382] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:03.642522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:03.643901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:03.702455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35c49-c729-4a57-82f3-989e1e706685 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:03.706501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:03.707193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:03.707476 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:03.707775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:03.717697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:03.719169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381dada-f04e-44e8-8c59-c4e3c44591ff service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:03.729401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1202/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:58:04.217355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:04.218969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:04.232355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8c22-e417-4ea1-87fe-bbb2e163064e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:04.237293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:04.238213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:04.238491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:04.238765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] PATH_INFO: `/v3/projects/e8177484577e4db78815bbdc3561f3a9` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:04.239948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8177484577e4db78815bbdc3561f3a9)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:04.241917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:04.425161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8177484577e4db78815bbdc3561f3a9', 'request_id': 'req-c152dd75-357b-4d4a-b614-712a0b0799aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:04.430662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8177484577e4db78815bbdc3561f3a9', 'request_id': 'req-c152dd75-357b-4d4a-b614-712a0b0799aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:04.505777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8177484577e4db78815bbdc3561f3a9', 'request_id': 'req-c152dd75-357b-4d4a-b614-712a0b0799aa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:04.517018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] The token cache is being invalidate because project e8177484577e4db78815bbdc3561f3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:58:04.517297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:04.517909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:04.519463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1182/2384] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:58:04 2022] DELETE /identity/v3/projects/e8177484577e4db78815bbdc3561f3a9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:58:07.867491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f7242-0144-4ae2-afb9-c622740a7a22 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:07.870042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f7242-0144-4ae2-afb9-c622740a7a22 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:07.870042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f7242-0144-4ae2-afb9-c622740a7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:07.886214 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-338f7242-0144-4ae2-afb9-c622740a7a22 None None] MFA Rules not processed for user `b10632cbf11b46b2b94afd5df59daa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:07.887400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-338f7242-0144-4ae2-afb9-c622740a7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:07.944494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1203/2385] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:15.198471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:15.199926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:15.256710 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152dd75-357b-4d4a-b614-712a0b0799aa admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:15.260301 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:15.260941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:15.261225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:15.261500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:15.263290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:15.328193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:15.330218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:15.340050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1183/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:58:27.917728 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6409c-8947-475a-b0e0-a294f34b2bb0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:27.918286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6409c-8947-475a-b0e0-a294f34b2bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:27.918397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6409c-8947-475a-b0e0-a294f34b2bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:27.936071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c5b6409c-8947-475a-b0e0-a294f34b2bb0 None None] MFA Rules not processed for user `add9c19abc0a46feb0be090a9a6641c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:27.937302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c5b6409c-8947-475a-b0e0-a294f34b2bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:27.998316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1204/2387] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:29.037642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:29.039107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:29.111743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca554-ebc4-4d36-b90e-ded35520ae35 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:29.116563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:29.117442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:29.117722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:29.117995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] PATH_INFO: `/v3/users/486b7896652245af90028eeba923d3e3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:29.119205 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=486b7896652245af90028eeba923d3e3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:29.121153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:29.326071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486b7896652245af90028eeba923d3e3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:29.334537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486b7896652245af90028eeba923d3e3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:29.335264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486b7896652245af90028eeba923d3e3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:29.336335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486b7896652245af90028eeba923d3e3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:29.437540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486b7896652245af90028eeba923d3e3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:29.455391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1184/2388] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 13:58:29 2022] DELETE /identity/v3/users/486b7896652245af90028eeba923d3e3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:58:29.459816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:29.460322 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:29.460427 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:29.477831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:29.479098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:29.536517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1205/2389] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:29.546144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:29.547532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:29.604690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eefd-74da-4cf8-924f-76af38546ced admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:29.608487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:29.609136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:29.609414 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:29.609684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:29.619196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:29.620619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa9278-add8-4785-abed-9e58404736ac service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:29.630520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1185/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:58:30.045927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.047532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:30.060659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a1fbd-70ca-43c5-948b-c8eaea4bcefd None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.066329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.067267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.067575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.067850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] PATH_INFO: `/v3/projects/026c00e65f4d4fae9e24703db79799fc` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.070034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] RBAC: Authorizing `identity:delete_project(project_id=026c00e65f4d4fae9e24703db79799fc)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.072012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.191326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026c00e65f4d4fae9e24703db79799fc', 'request_id': 'req-8cf0ffff-f00d-4647-8e8c-5a76b701945c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:30.196534 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026c00e65f4d4fae9e24703db79799fc', 'request_id': 'req-8cf0ffff-f00d-4647-8e8c-5a76b701945c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:30.254177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026c00e65f4d4fae9e24703db79799fc', 'request_id': 'req-8cf0ffff-f00d-4647-8e8c-5a76b701945c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:30.265535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] The token cache is being invalidate because project 026c00e65f4d4fae9e24703db79799fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 13:58:30.265820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:30.266474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-8cf0ffff-f00d-4647-8e8c-5a76b701945c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 13:58:30.268576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1206/2391] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 13:58:30 2022] DELETE /identity/v3/projects/026c00e65f4d4fae9e24703db79799fc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:58:30.273603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.274119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.277030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.295358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:30.296559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:30.361157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1186/2392] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:30.369034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.369423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.369763 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.387929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:30.389108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:30.397932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1207/2393] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:30.402285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.412531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55ba72-58c7-4de0-ac9c-cd8e4faab1c2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.417426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.418182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.418532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.418807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.419542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 13:58:30.419828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.421435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.432908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1187/2394] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 13:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 13:58:30.437246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.446594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e3abd-b1dc-4e93-97c5-a919758d85d7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.451375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.452094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.452392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.452665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.453353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.456872 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.552860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1208/2395] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 13:58:30 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:58:30.557023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.567618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7d204-4b21-48e3-8f64-d7299dc04256 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.622841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.623499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.623793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.624184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.624865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.627316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.758090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1188/2396] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 13:58:30 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 13:58:30.762219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.772912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e9b5-2bc8-49ed-affa-0d1a1bcc7b94 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.777460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.778142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.778425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.778696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.779424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.781084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.791407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1209/2397] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 13:58:30.798180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.808594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10741c93-1cbf-41af-b0fb-bf00fe1c2d68 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.813548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.814749 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.815059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.815335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.816069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.817651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ed79-7eaa-49b3-a5ce-2e67847d8e76 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.827881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1189/2398] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 13:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 13:58:30.832596 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:30.842942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455a557-c589-41df-827f-f518ff1229fb admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:30.847610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:30.848481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.848759 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.849031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] PATH_INFO: `/v3/projects/fc26737fc8c745fa952abfd840bf9278/users/baf7c7226e1747f397783c8d4429f601/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:30.864514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc26737fc8c745fa952abfd840bf9278, user_id=baf7c7226e1747f397783c8d4429f601, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:30.867209 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:30.975781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1210/2399] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 13:58:30 2022] PUT /identity/v3/projects/fc26737fc8c745fa952abfd840bf9278/users/baf7c7226e1747f397783c8d4429f601/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 13:58:30.981162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9e896-1e34-4635-8b67-c5a5836854ae None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:30.981451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9e896-1e34-4635-8b67-c5a5836854ae None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:30.981726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9e896-1e34-4635-8b67-c5a5836854ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:31.000648 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-08f9e896-1e34-4635-8b67-c5a5836854ae None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:31.002449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-08f9e896-1e34-4635-8b67-c5a5836854ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:31.062834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1190/2400] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:31.072779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:31.074495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:31.132241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ea1cb-2cf8-4f6b-b6da-68369f490fcf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:31.135860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:31.136493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:31.136772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:31.137045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:31.145846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:31.147299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:31.156445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1211/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:58:32.556971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b338-0e8b-41a2-8bcc-8c2499ef946f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:32.560501 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b338-0e8b-41a2-8bcc-8c2499ef946f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:32.560763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b338-0e8b-41a2-8bcc-8c2499ef946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:32.593875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3044b338-0e8b-41a2-8bcc-8c2499ef946f None None] MFA Rules not processed for user `baf7c7226e1747f397783c8d4429f601`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:32.595264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3044b338-0e8b-41a2-8bcc-8c2499ef946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:32.673020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1191/2402] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:32.684888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:58:32.689423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:32.745349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91552-bec2-4ccb-b3d8-3e9ba3ac52b4 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:58:32.749506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:58:32.750169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:32.750470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:32.750719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:32.760831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:58:32.762406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4407c5-ba28-4a60-a7ce-6c55effc0dd2 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:58:32.774700 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1212/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:58:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:58:34.646823 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:34.647352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:34.647352 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:34.667954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] MFA Rules not processed for user `baf7c7226e1747f397783c8d4429f601`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:34.669169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:34.676484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1192/2404] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:58:52.787907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:58:52.788468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:58:52.788468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:58:52.805839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] MFA Rules not processed for user `3337cd0a90cb4d72b093f6a912295125`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:58:52.807105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:58:52.862672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1213/2405] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:59:16.336559 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:16.338272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:16.350127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b9e9-9676-4b52-b3d0-9fc255500279 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:16.353725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:16.354404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:16.354685 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:16.354958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:16.356688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:16.425227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:16.426674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:16.438216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1193/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:59:17.614327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:17.623798 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78654b-7dbf-432f-9dff-68420df725e2 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:17.627375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:17.628003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:17.628280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:17.628552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:17.630345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:17.643239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:17.644640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:17.655748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1214/2407] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:59:33.579118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:33.587724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594768-1d5c-4163-af2e-7e0a02c6fddd service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:33.591858 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:33.592494 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:33.592782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:33.593056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:33.594891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:33.604548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:33.605978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:33.613942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1194/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:59:38.981813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:38.983259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:38.997533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7dfac-a57a-4bbf-a1b9-71c175c22d3f service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:39.003220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:39.003861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:39.004144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:39.004419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:39.006215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:39.018075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:39.019671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b68e-a5d3-4caa-88d9-baed76a0b5d3 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:39.030151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1215/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:59:46.498341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:46.499750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:46.515350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1357-abe4-4df5-9041-e81c1ec074cd service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:46.520787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:46.521413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:46.521691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:46.521966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:46.523686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:46.580063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:46.581652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:46.591192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1195/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:59:51.090723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:51.091223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:51.091329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:51.108918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] MFA Rules not processed for user `baf7c7226e1747f397783c8d4429f601`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:59:51.110121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:51.117088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1216/2411] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 13:59:51.350700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:51.360871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d185a-e1ec-48c8-8852-1db720302620 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:51.364485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:51.365190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:51.365476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:51.365753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:51.367566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:51.378727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:51.380193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47be6e-e00e-4054-96dd-90a5d2e8cef6 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:51.388286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1196/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 13:59:51.877934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 13:59:51.879436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:51.947845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccfea0-ef61-4c79-ae1e-3d9ef1a84aea None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 13:59:51.952697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 13:59:51.953839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:51.954153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:51.954422 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:51.956139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:51.967251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 13:59:51.969438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 13:59:51.979108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1217/2413] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 13:59:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 13:59:57.628976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 13:59:57.629504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 13:59:57.629504 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 13:59:57.646525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] MFA Rules not processed for user `b10632cbf11b46b2b94afd5df59daa25`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 13:59:57.647639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 13:59:57.705282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1197/2414] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:00:01.393737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:00:01.409161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc52b-a575-44bb-99fb-c983890ce25b service placement] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:00:01.414983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:00:01.415615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:00:01.415892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:00:01.416161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:00:01.417931 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:00:01.429787 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:00:01.431394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ef8e1-af08-4c15-900f-183795c2a1c6 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:00:01.442461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1218/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:00:03.711183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:00:03.725326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fab1b5-3fab-46d5-8982-75e8d6743526 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:00:03.730903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:00:03.731548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:00:03.731830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:00:03.732102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:00:03.733882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:00:03.745314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:00:03.747001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:00:03.756239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1198/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:00:10.871394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:00:10.871870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:00:10.871961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:00:10.890781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:00:10.891969 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:00:10.947053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1219/2417] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:00:11.097846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:00:11.099305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:00:11.168128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f960-422c-4e54-b070-c8754da44c2a service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:00:11.176451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:00:11.177106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:00:11.177387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:00:11.177652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:00:11.186365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:00:11.188170 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:00:11.196561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1199/2418] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 14:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:00:45.085854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:00:45.095341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54783-f1a3-4a18-9fbb-be3d529959cd None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:00:45.099681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:00:45.100323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:00:45.100597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:00:45.100865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:00:45.102640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:00:45.113697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:00:45.115196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:00:45.123918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1220/2419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:00:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:01:08.276690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:01:08.285813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cbe3b-556d-4299-b777-0ae0704bb009 service swift] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:01:08.290337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:01:08.290979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:01:08.291259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:01:08.291532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:01:08.293321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:01:08.350774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:01:08.352870 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:01:08.361777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1200/2420] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:01:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:02:13.131580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:02:13.147014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397721-4f2a-46f5-acbf-0389773ec0c3 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:02:13.152436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:02:13.153068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:02:13.153343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:02:13.153609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:02:13.155909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:02:13.211680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:02:13.213221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:02:13.222239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1221/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:02:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:02:21.519241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:02:21.520614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:02:21.535560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f5fdd-ac2c-48cf-bdd9-c10a5e285832 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:02:21.540432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:02:21.541126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:02:21.541353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:02:21.541641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:02:21.543384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:02:21.554417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:02:21.556023 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:02:21.566270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1201/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:02:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:05:09.749586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:09.750963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:05:09.762334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395205-8531-4e45-bed0-892435572b8b service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:09.765843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:09.766500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:09.766775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:09.767045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:09.776920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:09.778367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:09.789448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1222/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:05:09.796212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:09.805762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf17b-b2cd-4413-8f90-2afee09c7b3a service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:09.809213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:09.809836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:09.810151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:09.810420 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:09.818716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:09.820122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:09.846262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1202/2424] 10.222.0.26 () {60 vars in 1396 bytes} [Thu May 5 14:05:09 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:05:09.892008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:09.900829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4d11-2e43-4293-a2b9-587b7832f3e6 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:09.904473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:09.905096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:09.905402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:09.905670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:09.915705 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:09.917228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:09.943891 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1223/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:05:09.987266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:09.995797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630224d1-d616-40a8-ae03-0023b5de71ba service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:09.999337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:09.999961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:10.000237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:10.000508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:10.008660 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:10.010098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:10.018633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1203/2426] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:05:10.044210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:10.052736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30816c5b-0285-49fa-ac8d-d39404de0be8 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:10.056575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:10.057203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:10.057485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:10.057758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:10.068154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:10.069600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:10.080423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1224/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:05:31.224758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:31.233918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff21219-30e6-48ce-9447-0845b687b1a2 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:31.237470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:31.238132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:31.238411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:31.239348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:31.246658 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:31.248074 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:31.255850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1204/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:05:45.085991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:05:45.097266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c393c-07cf-422f-a03e-58b57d030dfa service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:05:45.104105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:05:45.104768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:05:45.105044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:05:45.105312 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:05:45.113461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:05:45.115098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:05:45.141271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1225/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:06:08.107523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:06:08.120078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07464-d32e-4a66-90d3-50439d62d828 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:06:08.125655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:06:08.126304 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:06:08.126584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:06:08.126854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:06:08.134993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:06:08.136563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:06:08.162833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1205/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:06:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:07:15.348647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:07:15.385159 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3e295-ef12-49ac-a673-8c169f402d54 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:07:15.389200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:07:15.389831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:07:15.390138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:07:15.390409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:07:15.411647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:07:15.413048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:07:15.438085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1226/2431] 10.222.0.26 () {60 vars in 1396 bytes} [Thu May 5 14:07:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:07:25.483922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:07:25.533909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205fe1-c90f-4109-834f-11c5ee6a3246 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:07:25.538954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:07:25.539589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:07:25.539871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:07:25.540145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:07:25.549146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:07:25.550771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:07:25.560372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1206/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:07:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:10:35.192398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:10:35.194475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:10:35.279452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9ef2-dc56-45f8-848a-76d4c7ac4366 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:10:35.283091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:10:35.283732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:10:35.284013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:10:35.284290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:10:35.286202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:10:35.295414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:10:35.296845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:10:35.304546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1227/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:11:10.591054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:10.648206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d849e8-6bf7-49a2-95a9-bb231eda069a service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:10.651697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:10.653150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:10.653423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:10.653689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:10.655579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:10.745210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:10.747228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:10.767829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1207/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:10.774991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:10.784054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fb2f1-253e-481e-b963-b6e2e7069480 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:10.787779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:10.788404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:10.788683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:10.788953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:10.790888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:10.860003 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:10.861448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:10.870597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1228/2435] 10.222.0.26 () {60 vars in 1396 bytes} [Thu May 5 14:11:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:10.913135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:10.923342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029058-dfb6-4608-9725-3cce343b7b54 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:10.923839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:10.925364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:10.927080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:10.927742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:10.928021 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:10.928417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:10.930278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:10.940496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd594-888e-48f5-9fde-cdee3e9e70f5 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:10.943608 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:10.945031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:10.946049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:10.946687 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:10.946987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:10.947261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:10.949089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:10.955978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1208/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:11:10.963009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:10.971396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439df3-5c53-42c6-8ee1-58bd8ac657a5 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:10.975266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:10.976068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:10.976199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:10.976410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:10.978396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:11.025944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:11.028147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:11.037804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1229/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:11.066441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:11.067892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:11.077386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1209/2438] 10.222.0.26 () {60 vars in 1396 bytes} [Thu May 5 14:11:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:11:11.123098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:11.132244 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:11.136143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fbb30-1b31-40fc-bc5c-32dae921f700 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:11.142554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:11.142846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29988-1f64-46f6-bce6-e75ade245e10 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:11.143196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:11.143481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:11.143744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:11.145643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:11.146813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:11.147450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:11.147780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:11.148003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:11.149961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:11.217995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:11.219543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:11.222309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:11.223776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:11.228825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1230/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:11.233900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1210/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:11:11.322772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:11.331822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e3e1b-5b00-46f5-8ebf-2ac44b352eb6 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:11.336058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:11.336688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:11.336963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:11.337231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:11.339138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:11.417658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:11.419669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95bc6d-8919-4d20-a9c6-771072ac81da service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:11.437236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1231/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:17.288819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:17.303242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ccaa-0a10-4e83-917b-30b2235a3742 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:17.306866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:17.307506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:17.307883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:17.308120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:17.310183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:17.411084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:17.412953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:17.433580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1211/2442] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:11:17.443454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:17.443961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:17.444088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:17.502685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:11:17.503879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:17.565213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1232/2443] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:11:17.699048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:17.700633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:17.788765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff342f-8207-49e1-8778-437237655d9f service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:17.793736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:17.794409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:17.794720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:17.794993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:17.803048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:17.804631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1413ab1-4f07-483b-bf43-42229b052c23 service swift] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:17.813987 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1212/2444] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 14:11:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:11:20.505809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:20.518882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dfc42-4212-464f-b0a4-b1052babae66 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:20.524436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:20.525088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:20.525372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:20.525648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:20.527570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:20.539747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:20.541335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2330-385b-4cae-834f-3bafd1db67ed service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:20.552096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1233/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:20.742155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:20.742745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:20.742745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] PATH_INFO: `/` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:20.744877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1213/2446] 10.222.0.26 () {54 vars in 912 bytes} [Thu May 5 14:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 14:11:20.751531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:20.752029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:20.752487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:20.831890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] MFA Rules not processed for user `f322aed419054297851d892da1249ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:11:20.833110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:20.904458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1234/2447] 10.222.0.26 () {58 vars in 1009 bytes} [Thu May 5 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:11:20.931091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:20.936233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:20.962006 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea447b-7dfd-4467-b399-0626bc479f73 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:20.972982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:20.973191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:20.973448 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:20.973619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:20.995153 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:20.996786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:21.008459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1214/2448] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:11:26.193294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:26.194768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:26.208443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d34726-5df7-4539-b1cb-e67c5bd9ebf5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:26.212992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:26.213868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:26.214181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:26.214460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] PATH_INFO: `/v3/users/df7b5849a9214c41ab39669aa1b62eac` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:26.215648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7b5849a9214c41ab39669aa1b62eac)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:26.218237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:26.370320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7b5849a9214c41ab39669aa1b62eac'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.377765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7b5849a9214c41ab39669aa1b62eac'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.378469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7b5849a9214c41ab39669aa1b62eac'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.455083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7b5849a9214c41ab39669aa1b62eac'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.455858 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7b5849a9214c41ab39669aa1b62eac'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.474167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1235/2449] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:11:26 2022] DELETE /identity/v3/users/df7b5849a9214c41ab39669aa1b62eac => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:11:26.719687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:26.735365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae530c-065d-43bc-81c8-c8601124453f service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:26.790741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:26.791591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:26.791875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:26.792152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] PATH_INFO: `/v3/projects/a4ec75326b484292937db17eccee43f3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:26.793329 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ec75326b484292937db17eccee43f3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:26.795779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:26.915880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ec75326b484292937db17eccee43f3', 'request_id': 'req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:26.922043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ec75326b484292937db17eccee43f3', 'request_id': 'req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.008431 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ec75326b484292937db17eccee43f3', 'request_id': 'req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.018264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] The token cache is being invalidate because project a4ec75326b484292937db17eccee43f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:11:27.018551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.019388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.021110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1215/2450] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:11:26 2022] DELETE /identity/v3/projects/a4ec75326b484292937db17eccee43f3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:11:27.025022 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:27.026524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:27.039550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c7b0-0573-489f-8f91-b87c021a5886 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:27.095468 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:27.096367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:27.096644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:27.096912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] PATH_INFO: `/v3/users/141f64d16ff545ceb06efbdb99e858e9` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:27.111020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141f64d16ff545ceb06efbdb99e858e9)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:27.112945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:27.280025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141f64d16ff545ceb06efbdb99e858e9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.286633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141f64d16ff545ceb06efbdb99e858e9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.287293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141f64d16ff545ceb06efbdb99e858e9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.403200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141f64d16ff545ceb06efbdb99e858e9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.403816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141f64d16ff545ceb06efbdb99e858e9'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.421739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1236/2451] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:11:27 2022] DELETE /identity/v3/users/141f64d16ff545ceb06efbdb99e858e9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:11:27.650389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:11:27.651934 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:11:27.667156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0bc7-5ffd-41b8-a4a9-c4eb825492ab admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:11:27.730382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:11:27.731239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:11:27.731543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:11:27.731813 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] PATH_INFO: `/v3/projects/0fce70215948486f9a622fa8273cab28` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:11:27.741972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fce70215948486f9a622fa8273cab28)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:11:27.743897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:11:27.848970 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fce70215948486f9a622fa8273cab28', 'request_id': 'req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.854563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fce70215948486f9a622fa8273cab28', 'request_id': 'req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.940318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fce70215948486f9a622fa8273cab28', 'request_id': 'req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.952496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] The token cache is being invalidate because project 0fce70215948486f9a622fa8273cab28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:11:27.952778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.953394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:11:27.954958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1216/2452] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:11:27 2022] DELETE /identity/v3/projects/0fce70215948486f9a622fa8273cab28 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:12:14.991163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:12:14.992577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:12:15.058732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ede70-f77b-4188-ab09-954ea500e3b5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:12:15.107388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:12:15.108036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:12:15.108311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:12:15.108578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:12:15.110359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:12:15.176367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:12:15.177846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:12:15.186829 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1237/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:12:30.480936 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:12:30.482455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:12:30.549233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e81d5-6c34-4736-a6cf-64ee29cdf46d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:12:30.554178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:12:30.554815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:12:30.555088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:12:30.555355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:12:30.557103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:12:30.568262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:12:30.569819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:12:30.579667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1217/2454] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:12:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:15:36.177248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:15:36.178676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:15:36.233232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf55ad-7ea0-4eb1-8f29-dcae447879b3 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:15:36.236771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:15:36.237400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:15:36.237677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:15:36.237947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:15:36.239689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:15:36.249217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:15:36.250663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:15:36.258285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1238/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:15:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:16:10.049588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:16:10.050999 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.062533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cebab1-09be-4605-bfab-253ed974765e service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:16:10.066133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:16:10.066756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:16:10.067033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:16:10.067309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:16:10.068966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.136347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:16:10.137778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:16:10.155307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1218/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:16:10.205892 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:16:10.207375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.277621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12059835-52a0-476a-b084-d15fe6d4d14f service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:16:10.283223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:16:10.283864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:16:10.284144 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:16:10.284418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:16:10.286213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.360124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:16:10.374795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:16:10.379864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1239/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:16:10.430379 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:16:10.440130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f60d2-5576-4453-8623-631b3174c25d service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:16:10.443680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:16:10.444399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:16:10.444683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:16:10.444955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:16:10.446762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.460232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:16:10.461580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:16:10.473040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1219/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:16:10.743569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:16:10.744862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.759002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e7ed-ad28-4bd7-a6bc-baf1189cc8e0 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:16:10.767134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:16:10.768727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:16:10.769014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:16:10.769291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:16:10.771067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:10.841461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:16:10.843082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:16:10.860882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1240/2459] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:16:11.060358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:16:11.069560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be587a4-a071-4e38-94d2-a6ef4e193384 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:16:11.073104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:16:11.073734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:16:11.074034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:16:11.074315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:16:11.076571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:16:11.134929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:16:11.136751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:16:11.146842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1220/2460] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:16:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:17:16.218754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:17:16.220139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:17:16.251009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50d4d-fee4-440a-875e-686256a092ea service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:17:16.254640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:17:16.255275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:17:16.255557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:17:16.255832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:17:16.264141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:17:16.265554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:17:16.290994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1241/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:17:16.717465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:17:16.726654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a337-8dc7-47c8-a1c8-86a738dd1c30 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:17:16.730399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:17:16.731839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:17:16.732128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:17:16.732396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:17:16.734135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:17:16.746967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:17:16.748369 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:17:16.758830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1221/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:17:17.854439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:17:17.868186 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e27f-502e-493a-84ef-5cde82cc7a77 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:17:17.875622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:17:17.876345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:17:17.876625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:17:17.876910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:17:17.878692 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:17:17.891021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:17:17.894267 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:17:17.903480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1242/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:17:34.458569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:17:34.460186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:17:34.516990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361b971-25a8-4e1f-990e-ef9c041f3b39 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:17:34.522139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:17:34.522781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:17:34.523059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:17:34.523328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:17:34.534097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:17:34.535676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:17:34.546125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1222/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:20:39.856264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:20:39.884165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf865-8766-4a50-b796-1f95b479edb0 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:20:39.887793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:20:39.888421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:20:39.888699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:20:39.888970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:20:39.896535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:20:39.897948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:20:39.905600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1243/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:21:10.219506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:21:10.229232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499289ed-8f12-4246-8f3b-9969c28d5586 service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:21:10.233057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:21:10.233680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:21:10.233960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:21:10.234279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:21:10.243081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:21:10.244484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:21:10.253291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1223/2466] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:21:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:21:11.126183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:21:11.146041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72d0c-31f2-4227-be04-ec15d301dbda service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:21:11.157091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:21:11.158170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:21:11.158170 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:21:11.158413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:21:11.181826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:21:11.183307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:21:11.207455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1244/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:21:11.227118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:21:11.235758 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da01d-4c38-4dd4-8c22-319991d67f49 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:21:11.239511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:21:11.240144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:21:11.240424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:21:11.240698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:21:11.249809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:21:11.251266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:21:11.270219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1224/2468] 10.222.0.26 () {60 vars in 1396 bytes} [Thu May 5 14:21:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:21:11.948520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:21:11.959849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2ee60-55af-4658-bc79-5aef7e901bb5 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:21:11.964011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:21:11.964723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:21:11.964992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:21:11.965263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:21:11.977832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:21:11.979744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:21:11.990636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1245/2469] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:21:12.036827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:21:12.046943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1449b5-635f-4f42-9630-cb7c93b514c3 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:21:12.051331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:21:12.054555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:21:12.054555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:21:12.054555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:21:12.061860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:21:12.063397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:21:12.073065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1225/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:22:16.735161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:22:16.744240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef153-cdc0-48ea-9301-78f35f395ed9 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:22:16.747782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:22:16.748434 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:22:16.748712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:22:16.748982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:22:16.758831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:22:16.760236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:22:16.771310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1246/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:22:16.978280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:22:16.990810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a67d89-6697-4956-b1ff-7847dacab8a3 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:22:16.996259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:22:16.996883 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:22:16.997165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:22:16.997441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:22:16.999337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:22:17.077601 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:22:17.079783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06156a18-ead1-49c6-9c16-25b987b920f4 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:22:17.088582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1226/2472] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:22:41.106771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:22:41.108307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:22:41.184439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df46ad-7173-48c0-aee6-b5664714d207 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:22:41.189259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:22:41.189888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:22:41.190193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:22:41.190460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:22:41.192260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:22:41.203026 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:22:41.204613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:22:41.214052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1247/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:23:16.732043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:16.732599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:16.732716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:16.788423 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] MFA Rules not processed for user `508b8f3b14414a3098cb79eaf0721e75`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:23:16.789614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:16.850808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1227/2474] 10.222.0.26 () {58 vars in 967 bytes} [Thu May 5 14:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:23:16.976122 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:16.977546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:17.066507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a29e-162c-4e93-b998-322d12db100a service placement] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:17.071455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f07d46de6e48e19f316d764d86fd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:17.072089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:17.072366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:17.072637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:17.080420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:17.082120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:17.089786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1248/2475] 10.222.0.26 () {60 vars in 1384 bytes} [Thu May 5 14:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 14:23:18.319609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:18.329045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc8137-fda6-458a-9788-cab0c80f0da2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:18.332618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:18.333255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:18.333533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:18.333804 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:18.335602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:18.416042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:18.417460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:18.439449 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1228/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:23:25.835381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:25.836817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:25.849837 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd52098-84c9-4ae0-b72b-ca349bf15a0c service swift] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:25.854388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:25.855244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:25.855520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:25.855789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] PATH_INFO: `/v3/users/a07bae627665426fba032d7757685fd1` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:25.857215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07bae627665426fba032d7757685fd1)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:25.859205 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:26.002775 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07bae627665426fba032d7757685fd1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.009418 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07bae627665426fba032d7757685fd1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.010107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07bae627665426fba032d7757685fd1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.064180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07bae627665426fba032d7757685fd1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.064734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07bae627665426fba032d7757685fd1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.081627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1249/2477] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:23:25 2022] DELETE /identity/v3/users/a07bae627665426fba032d7757685fd1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:23:26.304718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:26.316044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b613e4-1ae6-463b-8179-f7ff6ed1dcae service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:26.373947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:26.375339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:26.375616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:26.375888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] PATH_INFO: `/v3/projects/d2c9372df138414191186d3c950d2e23` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:26.377079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c9372df138414191186d3c950d2e23)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:26.379056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:26.482049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c9372df138414191186d3c950d2e23', 'request_id': 'req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.491254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c9372df138414191186d3c950d2e23', 'request_id': 'req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.566540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c9372df138414191186d3c950d2e23', 'request_id': 'req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.578711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] The token cache is being invalidate because project d2c9372df138414191186d3c950d2e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:23:26.578995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.582623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.582623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1229/2478] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:23:26 2022] DELETE /identity/v3/projects/d2c9372df138414191186d3c950d2e23 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:23:26.585129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:26.586625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:26.599607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3382e0-8f0e-4b97-a838-d8a3ff16f41a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:26.653606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:26.654491 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:26.654771 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:26.655044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] PATH_INFO: `/v3/users/f6baac3b26ef47db94dcdc97f713e67a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:26.668203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6baac3b26ef47db94dcdc97f713e67a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:26.670198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:26.808406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6baac3b26ef47db94dcdc97f713e67a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.815588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6baac3b26ef47db94dcdc97f713e67a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.816252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6baac3b26ef47db94dcdc97f713e67a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.886120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6baac3b26ef47db94dcdc97f713e67a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.886765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6baac3b26ef47db94dcdc97f713e67a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:26.903532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1250/2479] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:23:26 2022] DELETE /identity/v3/users/f6baac3b26ef47db94dcdc97f713e67a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:23:27.191160 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:23:27.192592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:23:27.205242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd0061-a16c-48d4-8f7f-eb8da2a970c0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:23:27.261546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:23:27.262540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:23:27.262822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:23:27.263109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] PATH_INFO: `/v3/projects/7f9474c2751047eeab39b5708dfa298b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:23:27.273339 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9474c2751047eeab39b5708dfa298b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:23:27.275288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:23:27.406550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9474c2751047eeab39b5708dfa298b', 'request_id': 'req-37f4a73c-a8eb-49d0-84a2-e534d331b896'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:27.412075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9474c2751047eeab39b5708dfa298b', 'request_id': 'req-37f4a73c-a8eb-49d0-84a2-e534d331b896'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:27.475286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9474c2751047eeab39b5708dfa298b', 'request_id': 'req-37f4a73c-a8eb-49d0-84a2-e534d331b896'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:27.487621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] The token cache is being invalidate because project 7f9474c2751047eeab39b5708dfa298b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:23:27.487900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:27.488522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:23:27.490071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1230/2480] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:23:27 2022] DELETE /identity/v3/projects/7f9474c2751047eeab39b5708dfa298b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:25:19.443526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:19.445510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:19.514498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab4fa-de9f-4353-a03e-adbbe4160a1d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:19.563602 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:19.563792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:19.563947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:19.564221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:19.566039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:19.626366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:19.627797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:19.637316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1251/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:23.386950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:23.388573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:23.402701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a73c-a8eb-49d0-84a2-e534d331b896 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:23.407463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:23.409051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:23.409295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:23.409661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] PATH_INFO: `/v3/users/add9c19abc0a46feb0be090a9a6641c1` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:23.424204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=add9c19abc0a46feb0be090a9a6641c1)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:23.426209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:23.599656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add9c19abc0a46feb0be090a9a6641c1'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:23.606279 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add9c19abc0a46feb0be090a9a6641c1'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:23.606989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add9c19abc0a46feb0be090a9a6641c1'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:23.607589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add9c19abc0a46feb0be090a9a6641c1'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:23.649361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-949b172b-2ef2-4b22-b69e-e8a6a42709bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add9c19abc0a46feb0be090a9a6641c1'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:23.665734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1231/2482] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:25:23 2022] DELETE /identity/v3/users/add9c19abc0a46feb0be090a9a6641c1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:25:23.884841 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:23.895576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c9e37-46a8-473c-968c-ec1b7ad50a40 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:23.953165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:23.954030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:23.954893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:23.955164 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] PATH_INFO: `/v3/projects/8536ba08456944f5a554574f98c72fb2` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:23.956326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8536ba08456944f5a554574f98c72fb2)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:23.958318 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.059821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8536ba08456944f5a554574f98c72fb2', 'request_id': 'req-7d82540c-3701-464a-a07a-4468e313d281'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:24.065306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8536ba08456944f5a554574f98c72fb2', 'request_id': 'req-7d82540c-3701-464a-a07a-4468e313d281'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:24.129704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8536ba08456944f5a554574f98c72fb2', 'request_id': 'req-7d82540c-3701-464a-a07a-4468e313d281'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:24.141635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] The token cache is being invalidate because project 8536ba08456944f5a554574f98c72fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:25:24.142453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:24.143096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-7d82540c-3701-464a-a07a-4468e313d281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:25:24.144814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1252/2483] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:25:23 2022] DELETE /identity/v3/projects/8536ba08456944f5a554574f98c72fb2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:25:24.150711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.151068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.151412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.208789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:25:24.210303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:24.268214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1232/2484] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:25:24.275978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.276258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.276533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.294880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:25:24.296051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:24.304295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1253/2485] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:25:24.308286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.318099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f489c-2aa1-4db9-9b1b-59f51d2a4a19 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.322578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.323216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.323496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.323769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.324485 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:25:24.324786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.326397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.338121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1233/2486] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:25:24.342075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.351056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2e7ce-47db-4a0f-8af0-25402964f553 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.355640 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.356274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.356554 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.356828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.357519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.359739 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.445618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1254/2487] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:25:24 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:25:24.449802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.460183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c739-cf24-43e4-b87c-4a56bfe7cc2f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.514475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.515132 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.515411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.515684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.516368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.518937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.586630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1234/2488] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:25:24 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:25:24.590618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.600548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4199-e59b-4184-9f3f-67a89cce1b54 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.605125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.605772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.606081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.606354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.607071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.608909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.618398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1255/2489] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:25:24.622058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.632706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cdf5e-b7fa-48d8-b9c5-9468ff225d22 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.637255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.637893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.638242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.642560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.642560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.642560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9579f2-5684-4e46-b6be-4454bcaf3cea admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.651342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1235/2490] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:25:24.655387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.665128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c4e2-c196-4636-8acf-c69d40d52587 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.669697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.670583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.670864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.671135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] PATH_INFO: `/v3/projects/8fc1b60b8b0d4479970f34e29312783f/users/795830eaa7be4737a520a63d3801e2f3/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.686128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc1b60b8b0d4479970f34e29312783f, user_id=795830eaa7be4737a520a63d3801e2f3, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.689391 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.752566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1256/2491] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:25:24 2022] PUT /identity/v3/projects/8fc1b60b8b0d4479970f34e29312783f/users/795830eaa7be4737a520a63d3801e2f3/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:25:24.757633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0ea3-b4fa-4dce-83a0-309f9d24390b None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.757916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0ea3-b4fa-4dce-83a0-309f9d24390b None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.758221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0ea3-b4fa-4dce-83a0-309f9d24390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.775538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-be6a0ea3-b4fa-4dce-83a0-309f9d24390b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:25:24.776723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-be6a0ea3-b4fa-4dce-83a0-309f9d24390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:24.832885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1236/2492] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:25:24.842265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:24.843946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:24.902224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7bfe1-e503-4994-aca0-3b44cce35383 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:24.905772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:24.906463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:24.906741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:24.907008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:24.915752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:24.917174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:24.926840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1257/2493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:30.189285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e220-ed3e-4bd2-aefd-45b3f6923aec None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:30.189789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e220-ed3e-4bd2-aefd-45b3f6923aec None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:30.189894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e220-ed3e-4bd2-aefd-45b3f6923aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:30.217260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ff65e220-ed3e-4bd2-aefd-45b3f6923aec None None] MFA Rules not processed for user `795830eaa7be4737a520a63d3801e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:25:30.218490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ff65e220-ed3e-4bd2-aefd-45b3f6923aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:30.296991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1237/2494] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:25:30.308288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:30.309974 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:30.408445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487e474-d08d-4ba6-9542-d85cc4b4f518 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:30.414042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:30.414729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:30.415015 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:30.415289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:30.424610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:30.426295 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:30.435607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1258/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:32.819164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:32.819735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:32.819735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:32.839633 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] MFA Rules not processed for user `795830eaa7be4737a520a63d3801e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:25:32.841032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:32.849456 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1238/2496] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:25:33.197569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:33.213442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72e20-249a-44f2-8e2f-a73d6484db79 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:33.217229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:33.218127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:33.218410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:33.218684 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:33.220493 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:33.235113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:33.237239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:33.246093 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1259/2497] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:33.701606 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:33.704526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:33.794848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62fc0f-66e6-4a1d-80fc-0eeb51398573 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:33.799837 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:33.800662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:33.800947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:33.801223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:33.803059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:33.815218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:33.816882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:33.827351 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1239/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:37.995934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:38.012886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9db5f-bb69-4259-a024-118313339aee service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:38.019845 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:38.022935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:38.022935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:38.022935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:38.022935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:38.037101 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:38.038844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:38.050879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1260/2499] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:44.187797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:44.197466 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8b78-f85c-4ede-895b-2ae84e71f5aa service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:44.201372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:44.202112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:44.202468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:44.202811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:44.204643 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:44.214911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:44.216395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:44.225070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1240/2500] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:25:44.534253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:25:44.546548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2490d1-dbe0-4b17-a0ca-8bfd3003e926 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:25:44.552264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:25:44.552906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:25:44.553191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:25:44.553467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:25:44.555248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:25:44.568928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:25:44.570682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:25:44.582210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1261/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:26:11.500891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:26:11.502299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:26:11.518308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c791-70d0-41dc-ae58-551ae3068c75 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:26:11.524567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:26:11.525206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:26:11.525572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:26:11.525852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:26:11.527671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:26:11.605537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:26:11.607168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:26:11.625278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1241/2502] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:26:11.677823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:26:11.686962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6d66-7caa-42b9-a0c1-b51e38aa5e47 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:26:11.690496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:26:11.691626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:26:11.691903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:26:11.692169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:26:11.693879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:26:11.707065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:26:11.708479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:26:11.718955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1262/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:13.200416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:13.201797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:13.268277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd915-80df-42c7-b4c9-5eb5f13086d7 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:13.271930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:13.272570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:13.272853 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:13.273145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:13.274992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:13.355825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:13.357254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:13.386497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1242/2504] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:16.796951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:16.805509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848a92-7006-459c-931e-a5bad8cd5090 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:16.809190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:16.809822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:16.810133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:16.810416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:16.812169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:16.835636 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:16.837055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:16.847816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1263/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:19.437208 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:19.438592 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:19.458751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36578-6d33-47f3-91ca-33aabdb74845 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:19.463238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:19.463871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:19.464148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:19.464421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:19.466225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:19.548444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:19.549780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f507e-367f-4464-ac94-89b74ffe1550 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:19.567192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1243/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:21.588179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:21.599826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92065-9498-4113-9bbb-d9dfc1eb59ff service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:21.614531 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:21.615683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:21.616654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:21.617097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:21.619182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:21.634346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:21.636176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:21.647635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1264/2507] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:26.972859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:26.973372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:26.973480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:26.991184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] MFA Rules not processed for user `795830eaa7be4737a520a63d3801e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:27:26.993369 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:26.999303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1244/2508] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:27:27.293208 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:27.302495 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1899-a63e-4e34-b889-145600253706 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:27.306874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:27.307510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:27.307815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:27.308090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:27.309827 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:27.319248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:27.320664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:27.328389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1265/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:27:44.419779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:27:44.421136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:44.464134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff07d-298f-4a66-a0e6-17074528bed2 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:27:44.469082 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:27:44.469708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:27:44.469983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:27:44.470283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:27:44.471964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:27:44.483394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:27:44.485211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5af4d3-814c-4eb3-9d9d-c44730ea0469 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:27:44.495407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1245/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:29:13.507882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:29:13.517403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5331e-d662-4721-a1e3-dd98b3921a65 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:29:13.521667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:29:13.523294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:29:13.523801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:29:13.524285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:29:13.526817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] Could not find project: d2c9372df138414191186d3c950d2e23.: keystone.exception.ProjectNotFound: Could not find project: d2c9372df138414191186d3c950d2e23. May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 05 14:29:13.563217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:29:13.564822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self._validate_token_resources() May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 14:29:13.566358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.get_or_create( May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application with Lock( May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._enter() May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.creator() May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application created_value = creator( May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 14:29:13.567819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 14:29:13.569203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d2c9372df138414191186d3c950d2e23. May 05 14:29:13.569203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: ERROR keystone.server.flask.application May 05 14:29:13.569203 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1266/2511] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:29:13 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 05 14:29:18.518401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:29:18.518401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:29:18.518401 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:29:18.535774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] MFA Rules not processed for user `795830eaa7be4737a520a63d3801e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:29:18.537103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:29:18.544595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1246/2512] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:30:47.833299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:30:47.862966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f35b-b347-42af-a6c9-b090a92c0491 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:30:47.866532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:30:47.867153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:30:47.867430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:30:47.867704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:30:47.874753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:30:47.876168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:30:47.884433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1267/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:30:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:07.185667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:07.201796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43175b6e-9418-4a95-a932-c3d3c2f82e2f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:07.208098 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:07.208847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:07.209163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:07.209439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:07.218830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:07.220585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:07.229566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1247/2514] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:10.315831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:10.329869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd306-04e5-4b7f-bfdb-ec12ad469fed service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:10.336029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647907-1637-414c-977c-5486232fdf23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:10.336673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647907-1637-414c-977c-5486232fdf23 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:10.336951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647907-1637-414c-977c-5486232fdf23 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:10.337221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647907-1637-414c-977c-5486232fdf23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:10.347052 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647907-1637-414c-977c-5486232fdf23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:10.348852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647907-1637-414c-977c-5486232fdf23 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:10.370432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1268/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:11.407684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:11.419867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c0bf4-8385-475a-8c5f-bbf4d641dadc service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:11.423901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:11.424607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:11.424901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:11.425179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:11.435997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:11.438452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:11.448561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1248/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:12.275834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647907-1637-414c-977c-5486232fdf23 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:12.297357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647907-1637-414c-977c-5486232fdf23 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:12.303557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:12.304455 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:12.312395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:12.312395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:12.395882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:12.415712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:12.440597 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1269/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:12.468199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:12.469731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:12.494807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996005-eaf8-4c40-96ac-95c29cdf5377 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:12.505123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:12.505869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:12.507676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:12.508119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:12.514002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:12.531158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:12.532718 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:12.557436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1249/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:13.267002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:13.269045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:13.290305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666609a9-319a-4e11-b75f-91fc1b19c550 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:13.294925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:13.295792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:13.296068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:13.296336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] PATH_INFO: `/v3/users/baf7c7226e1747f397783c8d4429f601` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:13.297614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf7c7226e1747f397783c8d4429f601)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:13.299678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:13.502928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf7c7226e1747f397783c8d4429f601'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:13.525642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf7c7226e1747f397783c8d4429f601'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:13.527287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf7c7226e1747f397783c8d4429f601'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:13.604509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf7c7226e1747f397783c8d4429f601'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:13.606529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf7c7226e1747f397783c8d4429f601'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:13.626667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1270/2519] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:13 2022] DELETE /identity/v3/users/baf7c7226e1747f397783c8d4429f601 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:13.835646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:13.844164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3ebb8-943b-4121-aeff-09414a377616 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:13.872753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:13.874446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:13.894702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:13.896141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:13.896513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:13.896859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:13.899047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:13.943384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39d4f-4336-4651-b556-f4c2557e7362 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:13.948040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:13.948898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:13.949179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:13.949453 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] PATH_INFO: `/v3/projects/fc26737fc8c745fa952abfd840bf9278` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:13.950713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc26737fc8c745fa952abfd840bf9278)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:13.952643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:13.965229 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:13.966692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7305a75-5c8f-4386-9bc9-fd9f57708555 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:13.976743 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1250/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:14.083834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc26737fc8c745fa952abfd840bf9278', 'request_id': 'req-a1db206f-6c12-4e5e-adf7-a0488d851ac5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:14.089348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc26737fc8c745fa952abfd840bf9278', 'request_id': 'req-a1db206f-6c12-4e5e-adf7-a0488d851ac5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:14.163059 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc26737fc8c745fa952abfd840bf9278', 'request_id': 'req-a1db206f-6c12-4e5e-adf7-a0488d851ac5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:14.175081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] The token cache is being invalidate because project fc26737fc8c745fa952abfd840bf9278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:14.175365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:14.176012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a1db206f-6c12-4e5e-adf7-a0488d851ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:14.181712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1271/2521] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:13 2022] DELETE /identity/v3/projects/fc26737fc8c745fa952abfd840bf9278 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:14.188313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.188603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.188882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.209519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:14.210726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:14.270956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1251/2522] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:14.278878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.279369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.279661 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.299042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:14.300345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:14.308628 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1272/2523] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:14.312916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.323381 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b1aa-1efa-4195-9be9-fe88c7e6bb10 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.328029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.328678 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.328953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.329336 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.330100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:14.330403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.331989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.344319 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1252/2524] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:14.348786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.357918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcd848-b0b2-4d3d-b781-0c47be6f5aae None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.362569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.363210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.363770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.364039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.364736 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.366672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.453723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1273/2525] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:14 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:14.454952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.465365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c630-21f1-49d4-b83b-0c8150956bcd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.523895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.524491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.524796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.525071 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.525751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.527834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.609152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1253/2526] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:14 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:14.613686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.624027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc9d1-05d2-4149-90c6-46a2ffa24ba8 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.630618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.631288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.631768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.632055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.632847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.634608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.645998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1274/2527] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:14.649996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.660632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c6b6-2b22-4121-9fb3-95353a27f4ba admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.665778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.666585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.666912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.667207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.668965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.669761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67d210-c242-4695-a600-21299d0e04a5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.682462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1254/2528] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:14.686039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.696866 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6b3-dd07-4575-a2b5-0526a2d55bd4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.701854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.707815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.707815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.707815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] PATH_INFO: `/v3/projects/17339d2c28a140b39ca53672998c4ca7/users/8cfbd9192aae4f8a8bef093c630ce2cd/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.719926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17339d2c28a140b39ca53672998c4ca7, user_id=8cfbd9192aae4f8a8bef093c630ce2cd, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.722813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:14.786343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1275/2529] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:14 2022] PUT /identity/v3/projects/17339d2c28a140b39ca53672998c4ca7/users/8cfbd9192aae4f8a8bef093c630ce2cd/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:14.797478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.798552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.798552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.826902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] MFA Rules not processed for user `8cfbd9192aae4f8a8bef093c630ce2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:14.828103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:14.895523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1255/2530] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:14.907382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:14.909102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:14.972306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b1fcf-2938-4070-af89-4504f71621d5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:14.977309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:14.977977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:14.978286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:14.978560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:14.991040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:14.992501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:15.003907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1276/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:15.208099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:15.210032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:15.276325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1599fb-dffc-45e2-90ea-8ddc53ab8e1c None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:15.281315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:15.282866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:15.283337 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:15.283615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:15.285418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:15.353016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:15.354500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:15.365083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1256/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:17.711120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:17.728780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e17d-2f70-4970-8818-f93020746219 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:17.732794 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:17.733451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:17.734520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:17.734520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:17.743612 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:17.770691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:17.773044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:17.787190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1277/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:18.256635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:18.258640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:18.271258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9141d-9d08-4ec5-84e2-99f6cd9f0092 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:18.278118 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:18.279005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:18.279298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:18.279553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] PATH_INFO: `/v3/users/795830eaa7be4737a520a63d3801e2f3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:18.280897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795830eaa7be4737a520a63d3801e2f3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:18.282855 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:18.473508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795830eaa7be4737a520a63d3801e2f3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:18.480042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795830eaa7be4737a520a63d3801e2f3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:18.480695 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795830eaa7be4737a520a63d3801e2f3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:18.481374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795830eaa7be4737a520a63d3801e2f3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:18.539473 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-89f93de9-2930-4dc7-b64a-1088f23fac77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795830eaa7be4737a520a63d3801e2f3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:18.570959 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1257/2534] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:18 2022] DELETE /identity/v3/users/795830eaa7be4737a520a63d3801e2f3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:18.821895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:18.832928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291e3a-8036-4279-95ce-1a3cec3aca2f service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:18.903040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:18.903949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:18.904246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:18.904490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] PATH_INFO: `/v3/projects/8fc1b60b8b0d4479970f34e29312783f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:18.905724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc1b60b8b0d4479970f34e29312783f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:18.907672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.041569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc1b60b8b0d4479970f34e29312783f', 'request_id': 'req-763d01b5-2880-4006-b8d8-8692c84524e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:19.052917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc1b60b8b0d4479970f34e29312783f', 'request_id': 'req-763d01b5-2880-4006-b8d8-8692c84524e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:19.128701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc1b60b8b0d4479970f34e29312783f', 'request_id': 'req-763d01b5-2880-4006-b8d8-8692c84524e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:19.141166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] The token cache is being invalidate because project 8fc1b60b8b0d4479970f34e29312783f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:19.141451 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:19.142334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-763d01b5-2880-4006-b8d8-8692c84524e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:19.143877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1278/2535] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:18 2022] DELETE /identity/v3/projects/8fc1b60b8b0d4479970f34e29312783f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:19.149507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.149905 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.150642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.168863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:19.170292 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:19.233926 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1258/2536] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:19.242399 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.242943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.243377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.263820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:19.265337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:19.273715 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1279/2537] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:19.277912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.287806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d214-17bc-4597-bb4b-abed6b32fd88 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.292521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.293385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.293826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.294299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.295214 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:19.295702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.297661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.314181 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1259/2538] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:31:19.315285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.327150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f5071-6d26-41c5-a377-f14a1e9b0eeb None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.333076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.334307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.334594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.334859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.335734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.337981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.443366 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1280/2539] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:19 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:19.447562 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.457536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6776-f4e2-4191-8532-6b95a6a1533d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.519276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.524429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.524429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.524429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.524429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.524429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.645799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1260/2540] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:19 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:19.649685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.660281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d777-eab0-4e07-8027-83684356ebd9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.666398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.667317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.667848 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.668335 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.669329 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.671384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.692863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1281/2541] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:19.694106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.704665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f47ab-0374-4e93-9001-7f195a660e74 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.711826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.712599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.713347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.713690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.714531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.716297 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9a13-43de-406d-a0d4-0a8c3b1e7375 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.731918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1261/2542] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:19.735328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.747448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76d94e-495e-4807-8725-1c9574dd973f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:19.752616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:19.753634 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.754049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.754377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] PATH_INFO: `/v3/projects/b00d8fd241954fb7b03c33a6b421f4ba/users/5806ac995f904d4284dcca5def66458b/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.785429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00d8fd241954fb7b03c33a6b421f4ba, user_id=5806ac995f904d4284dcca5def66458b, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:19.789632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:19.875894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1282/2543] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:19 2022] PUT /identity/v3/projects/b00d8fd241954fb7b03c33a6b421f4ba/users/5806ac995f904d4284dcca5def66458b/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:19.877748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:19.884904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:19.884904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:19.898400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:19.899867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:19.965407 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1262/2544] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:19.976228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:19.978297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:20.037862 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fc74-d6c8-4bb4-824e-184367111f8c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:20.041506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:20.042414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:20.042693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:20.042964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:20.052649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:20.054107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:20.074703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1283/2545] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:20.856680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:20.858443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:20.873624 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee5a64-140a-4433-8edf-f6274e57a222 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:20.879331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:20.886197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:20.886197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:20.886197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] PATH_INFO: `/v3/users/3337cd0a90cb4d72b093f6a912295125` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:20.886197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3337cd0a90cb4d72b093f6a912295125)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:20.886197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:21.122075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3337cd0a90cb4d72b093f6a912295125'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.128741 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3337cd0a90cb4d72b093f6a912295125'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.129428 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3337cd0a90cb4d72b093f6a912295125'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.130062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3337cd0a90cb4d72b093f6a912295125'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.230128 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-01206394-ef95-445d-ad95-3518adb8e3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3337cd0a90cb4d72b093f6a912295125'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.247746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1263/2546] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:20 2022] DELETE /identity/v3/users/3337cd0a90cb4d72b093f6a912295125 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:21.552182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:21.563517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce17-e694-43a9-9e7d-0fe7397bdc44 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:21.617679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:21.617967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:21.618283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:21.627064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:21.627978 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:21.628254 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:21.628523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] PATH_INFO: `/v3/projects/b3c2d40011044e5d86c205f3cf09d56e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:21.630349 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c2d40011044e5d86c205f3cf09d56e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:21.639825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:21.674572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] MFA Rules not processed for user `5806ac995f904d4284dcca5def66458b`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:21.677419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:21.769350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1264/2547] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:21.770634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:21.772070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:21.786824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc1cd-8ddd-4d58-bb90-b343abe99eb7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:21.790047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c2d40011044e5d86c205f3cf09d56e', 'request_id': 'req-14e6e0c3-6031-4e16-87c8-5568bbab2fce'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.817857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c2d40011044e5d86c205f3cf09d56e', 'request_id': 'req-14e6e0c3-6031-4e16-87c8-5568bbab2fce'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.888020 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:21.888690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:21.888967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:21.889386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:21.890202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:21.892112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:21.929477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c2d40011044e5d86c205f3cf09d56e', 'request_id': 'req-14e6e0c3-6031-4e16-87c8-5568bbab2fce'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.943762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] The token cache is being invalidate because project b3c2d40011044e5d86c205f3cf09d56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:21.944107 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.944758 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-14e6e0c3-6031-4e16-87c8-5568bbab2fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:21.946454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1284/2548] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:21 2022] DELETE /identity/v3/projects/b3c2d40011044e5d86c205f3cf09d56e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:21.958777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086d33-41b9-43dd-bd82-6a3e14368d0f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:21.962874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086d33-41b9-43dd-bd82-6a3e14368d0f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:21.962874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086d33-41b9-43dd-bd82-6a3e14368d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:21.984099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8b086d33-41b9-43dd-bd82-6a3e14368d0f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:21.985585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8b086d33-41b9-43dd-bd82-6a3e14368d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:22.008519 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1285/2549] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:22.021590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1265/2550] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:21 2022] POST /identity/v3/projects => generated 403 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:22.021696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.021696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.021696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.022047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.024536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:22.053311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:22.054741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:22.108550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82e44-180b-47ff-ae45-0aafb3ff8418 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.115239 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.115967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.116252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.116526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.117225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.119296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.144654 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1286/2551] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:22.149744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.161444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021cb0-20b1-4595-bc45-fd1d36622c36 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.164850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.165512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.165790 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.166088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.166823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:22.167348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.168922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.182696 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1287/2552] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:31:22.187137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.199756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0f68-06db-4bf6-8570-da9efa8117ce admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.208977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.209746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.210108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.210552 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.213678 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.215040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.219175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1266/2553] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:22 2022] POST /identity/v3/users => generated 308 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:22.220532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.235012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7a06-2193-40ef-b3be-31a9baf3a53b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.242101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.243092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.243644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.243919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.244795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.247644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.259005 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1267/2554] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:22.265677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.280871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688178-641e-48d9-b555-4340c980f950 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.286963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.287882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.288367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.288636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] PATH_INFO: `/v3/projects/6de3c795f81c43cea049fdd9ddeded15/users/55a1c4bc01ab45babf99d04d9d46b257/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.316469 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1288/2555] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:22 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:22.318075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de3c795f81c43cea049fdd9ddeded15, user_id=55a1c4bc01ab45babf99d04d9d46b257, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.320702 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.321086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.393492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1268/2556] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:22 2022] PUT /identity/v3/projects/6de3c795f81c43cea049fdd9ddeded15/users/55a1c4bc01ab45babf99d04d9d46b257/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:22.399223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.402104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b975a-ae8b-4238-9ab8-7da7d58557de admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.480867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e444d0-9264-45dc-a885-dace326dc2bc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.482105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.482888 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.483228 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.483437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.484222 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.486363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.493105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.501235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.501235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.501235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.501235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.501235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.507362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1269/2557] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:22.511467 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.521755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeeacc-d667-4a62-b2df-ff44b8ae1c4f admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.526816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.529845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.529845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.529845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] PATH_INFO: `/v3/projects/6de3c795f81c43cea049fdd9ddeded15/users/55a1c4bc01ab45babf99d04d9d46b257/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.530629 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de3c795f81c43cea049fdd9ddeded15, user_id=55a1c4bc01ab45babf99d04d9d46b257, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.533283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.544526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1270/2558] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:22 2022] PUT /identity/v3/projects/6de3c795f81c43cea049fdd9ddeded15/users/55a1c4bc01ab45babf99d04d9d46b257/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:22.580243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1289/2559] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:22 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:22.584981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.687972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2a79-e191-458f-bcdb-0dc26ce944bb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.693753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.694683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.694810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.695036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.695763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.697386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.710124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1271/2560] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:22.715185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.728004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87040f8b-47a6-4e56-bec6-440deefb6457 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.736749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.737954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.738282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.738558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.740475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.742104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfd294-d003-494a-afe6-c46d44667a7c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.753711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1290/2561] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:22.759470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:22.774662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63842-8315-47f8-8a53-481c4990158d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:22.779390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:22.780272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.780549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.780826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] PATH_INFO: `/v3/projects/6392c3e1cc3c4f0eabba0ad5f0bcedbd/users/33116c9aa0394d37ad74a9e174a7e535/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.798413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6392c3e1cc3c4f0eabba0ad5f0bcedbd, user_id=33116c9aa0394d37ad74a9e174a7e535, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:22.802384 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:22.896953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1272/2562] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:22 2022] PUT /identity/v3/projects/6392c3e1cc3c4f0eabba0ad5f0bcedbd/users/33116c9aa0394d37ad74a9e174a7e535/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:22.903718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:22.904127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:22.904478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:22.949061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] MFA Rules not processed for user `33116c9aa0394d37ad74a9e174a7e535`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:22.950835 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:23.031373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1291/2563] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:23.042735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:23.044411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:23.106952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04b99-5369-4019-82a2-16d610bd5809 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:23.113201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:23.115039 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:23.115320 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:23.116145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:23.125619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:23.127202 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:23.127740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:23.128700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:23.144785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1273/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:23.217920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e1638-e7f5-4ff7-a56c-33909a950c32 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:23.224462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:23.225510 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:23.226375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:23.226665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] PATH_INFO: `/v3/users/b10632cbf11b46b2b94afd5df59daa25` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:23.228178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10632cbf11b46b2b94afd5df59daa25)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:23.230248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:23.515105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10632cbf11b46b2b94afd5df59daa25'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:23.522738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10632cbf11b46b2b94afd5df59daa25'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:23.523444 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10632cbf11b46b2b94afd5df59daa25'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:23.631908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10632cbf11b46b2b94afd5df59daa25'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:23.632545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1303b71c-c3a8-4bbe-956d-d048375bdb38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10632cbf11b46b2b94afd5df59daa25'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:23.650613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1292/2565] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:23 2022] DELETE /identity/v3/users/b10632cbf11b46b2b94afd5df59daa25 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:23.920916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:23.921659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728b55-909b-49e3-8387-eac5d96d27d0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:23.922619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728b55-909b-49e3-8387-eac5d96d27d0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:23.927801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728b55-909b-49e3-8387-eac5d96d27d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:23.936095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0520-573c-4ade-b3cf-b1564e0bd0ee service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:23.973042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-38728b55-909b-49e3-8387-eac5d96d27d0 None None] MFA Rules not processed for user `55a1c4bc01ab45babf99d04d9d46b257`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:23.974741 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-38728b55-909b-49e3-8387-eac5d96d27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.016739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.017599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.017877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.018280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] PATH_INFO: `/v3/projects/0054a05e1c0b4300addba50adfb442ef` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.019505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0054a05e1c0b4300addba50adfb442ef)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.021943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.064917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1293/2566] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:24.154590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0054a05e1c0b4300addba50adfb442ef', 'request_id': 'req-5213cde7-dfaa-47cd-af3e-a828f2807e3a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.160126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0054a05e1c0b4300addba50adfb442ef', 'request_id': 'req-5213cde7-dfaa-47cd-af3e-a828f2807e3a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.259180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0054a05e1c0b4300addba50adfb442ef', 'request_id': 'req-5213cde7-dfaa-47cd-af3e-a828f2807e3a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.272145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] The token cache is being invalidate because project 0054a05e1c0b4300addba50adfb442ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:24.272438 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.273090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.274670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1274/2567] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:23 2022] DELETE /identity/v3/projects/0054a05e1c0b4300addba50adfb442ef => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:24.286288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.287012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3aad-2a53-4ed1-a9ff-8bed6923f06f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.287461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3aad-2a53-4ed1-a9ff-8bed6923f06f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.287765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3aad-2a53-4ed1-a9ff-8bed6923f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.287895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.305856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f97a3aad-2a53-4ed1-a9ff-8bed6923f06f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:24.307065 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f97a3aad-2a53-4ed1-a9ff-8bed6923f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.358230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cde7-dfaa-47cd-af3e-a828f2807e3a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.364028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.365087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.365362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.365639 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] PATH_INFO: `/v3/users/8cfbd9192aae4f8a8bef093c630ce2cd` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.369513 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfbd9192aae4f8a8bef093c630ce2cd)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.371304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1294/2568] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:24.371497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.380001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.380511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.381141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.402415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:24.403603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.411703 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1295/2569] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:24.415922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.425057 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbaf20-7d16-4f3b-9f03-2373fa3c96c9 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.430533 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.431166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.431443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.431706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.432430 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:24.432731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.434384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.447689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1296/2570] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:24.451614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.461116 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd23498-2ae2-48b5-9208-f8cf134fee61 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.466099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.466733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.467031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.467284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.467958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.470002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.568409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1297/2571] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:24.568409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.568703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfbd9192aae4f8a8bef093c630ce2cd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.577788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfbd9192aae4f8a8bef093c630ce2cd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.578615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfbd9192aae4f8a8bef093c630ce2cd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.579232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfbd9192aae4f8a8bef093c630ce2cd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.631760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e41c6e-5e72-4248-8e33-8dd239185ea1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.636530 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.637167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2f624e59-451e-47ce-b07e-ccd9455ce468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfbd9192aae4f8a8bef093c630ce2cd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:24.637315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.637471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.637743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.638480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.640657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.655665 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1275/2572] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:24 2022] DELETE /identity/v3/users/8cfbd9192aae4f8a8bef093c630ce2cd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:24.660147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.660437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.660763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.677863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:24.679171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.701031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1298/2573] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:24.706305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.706807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.727483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08287e0-8e20-43d8-a6ff-0f6ba3da4078 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.747556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1276/2574] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:24.759016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.760403 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:24.791234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.792319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.792836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.793313 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.794247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.796182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.807515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1299/2575] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:24.811524 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.819831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6d8b-6ac2-4137-a4c6-d2177114a9ad None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.823142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b6a2-63f5-4b39-900a-a13d7666c1ad admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.823571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.824272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.824553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.824829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.829072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.829999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.830401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.830933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.831818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.833630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.834557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.836044 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9541fa9-fd72-48d4-a066-a82c09024f62 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.844522 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1300/2576] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:24.846543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1277/2577] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:24.848831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:24.859401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1129-d852-47a3-9c11-de1e91e6f93e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:24.865443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:24.866372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.866698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.866970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] PATH_INFO: `/v3/projects/bd203cd7c9cb4b0aa36a21c54c098ac1/users/655d6e49c3a143f59417f327f218d0be/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:24.882697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd203cd7c9cb4b0aa36a21c54c098ac1, user_id=655d6e49c3a143f59417f327f218d0be, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:24.885410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:24.974671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1301/2578] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:24 2022] PUT /identity/v3/projects/bd203cd7c9cb4b0aa36a21c54c098ac1/users/655d6e49c3a143f59417f327f218d0be/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:24.985025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:24.985492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:24.985596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.019394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] MFA Rules not processed for user `655d6e49c3a143f59417f327f218d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:25.021549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:25.114444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1278/2579] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:25.118935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.210227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082be8-6a16-4534-bd8d-64f5ac2608c1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.215749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.216509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.216886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.217231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.218006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.220346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.299089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1302/2580] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:25 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:25.299898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.311808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a786d-27bc-4145-84bd-cda31bd5be1e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.364830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.366664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:25.370968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.371909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.372346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.372928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.373846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.376001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.383658 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73906-2677-46cb-99b6-e33e777bb6e6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.390412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.391548 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.391973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.392840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] PATH_INFO: `/v3/projects/17339d2c28a140b39ca53672998c4ca7` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.394340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17339d2c28a140b39ca53672998c4ca7)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.396943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.460400 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1279/2581] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:25 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:25.461365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.462908 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:25.474157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6c4f-09a4-41cc-8966-a28eb03f31f1 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.478689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.479515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.479790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.480058 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] PATH_INFO: `/v3/users/5806ac995f904d4284dcca5def66458b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.481242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5806ac995f904d4284dcca5def66458b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.483221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.513377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17339d2c28a140b39ca53672998c4ca7', 'request_id': 'req-1699c923-772c-427b-aa38-44f28a50f4b6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.518761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17339d2c28a140b39ca53672998c4ca7', 'request_id': 'req-1699c923-772c-427b-aa38-44f28a50f4b6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.619359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17339d2c28a140b39ca53672998c4ca7', 'request_id': 'req-1699c923-772c-427b-aa38-44f28a50f4b6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.628053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] The token cache is being invalidate because project 17339d2c28a140b39ca53672998c4ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:25.628343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.629178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.630650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1303/2582] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:25 2022] DELETE /identity/v3/projects/17339d2c28a140b39ca53672998c4ca7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:25.642182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.642182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:25.701709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c923-772c-427b-aa38-44f28a50f4b6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.706876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.707573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.708027 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.708846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.709053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.711068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.724094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1304/2583] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:25.728384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.735418 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5806ac995f904d4284dcca5def66458b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.742710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80b2-bd1c-4f51-8c28-cb21dd3c4bbd admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.745596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5806ac995f904d4284dcca5def66458b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.746670 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5806ac995f904d4284dcca5def66458b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.747472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5806ac995f904d4284dcca5def66458b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.749342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.750813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.751243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.751521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] PATH_INFO: `/v3/projects/1b34db1a62f94909929d5a1c224b37cc/users/c33a9e8bb5d54ac89eee339702cee748/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.771698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b34db1a62f94909929d5a1c224b37cc, user_id=c33a9e8bb5d54ac89eee339702cee748, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.774738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:25.820257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5806ac995f904d4284dcca5def66458b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:25.838121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1280/2584] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:25 2022] DELETE /identity/v3/users/5806ac995f904d4284dcca5def66458b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:25.855429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1305/2585] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:25 2022] PUT /identity/v3/projects/1b34db1a62f94909929d5a1c224b37cc/users/c33a9e8bb5d54ac89eee339702cee748/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:25.860531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:25.862144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:25.930867 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26ca2a-d310-4bf9-a0d7-c327f6819de5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:25.989152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:25.989814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:25.990119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:25.990866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:25.991598 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:25.993314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42094147-4a8d-4d6b-98ab-5c3245e34a46 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.003264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1281/2586] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:26.007796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.017897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55eb4-4d85-4310-b489-e2f0c95ef299 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.023075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.023944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.024224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.024497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] PATH_INFO: `/v3/projects/1b34db1a62f94909929d5a1c224b37cc/users/c33a9e8bb5d54ac89eee339702cee748/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.026570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b34db1a62f94909929d5a1c224b37cc, user_id=c33a9e8bb5d54ac89eee339702cee748, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.032050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.040008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1306/2587] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:26 2022] PUT /identity/v3/projects/1b34db1a62f94909929d5a1c224b37cc/users/c33a9e8bb5d54ac89eee339702cee748/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:26.051484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.051770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.052045 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.078367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] MFA Rules not processed for user `c33a9e8bb5d54ac89eee339702cee748`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:26.079593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.103555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.105368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.154683 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1282/2588] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:26.166653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.168338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.186540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbdca-bf07-4681-9ae3-6e5c281618b2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.191831 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.192712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.192993 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.193289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] PATH_INFO: `/v3/projects/b00d8fd241954fb7b03c33a6b421f4ba` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.194613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00d8fd241954fb7b03c33a6b421f4ba)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.196701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.230690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83a49-c6ed-48a7-b443-3bc527b44032 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.234919 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.235766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.236046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.236316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.247875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.273067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.273067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1283/2589] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:26.331831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.343136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc9d1-1160-4edb-a610-26f8a40cae98 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.347689 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.348565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.348845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.349121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] PATH_INFO: `/v3/users/655d6e49c3a143f59417f327f218d0be` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.350358 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=655d6e49c3a143f59417f327f218d0be)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.352248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.559353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00d8fd241954fb7b03c33a6b421f4ba', 'request_id': 'req-b73ff273-0959-4dcf-96cd-21cbf1b89399'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.560149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655d6e49c3a143f59417f327f218d0be'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.564564 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00d8fd241954fb7b03c33a6b421f4ba', 'request_id': 'req-b73ff273-0959-4dcf-96cd-21cbf1b89399'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.566842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655d6e49c3a143f59417f327f218d0be'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.568038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655d6e49c3a143f59417f327f218d0be'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.568649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655d6e49c3a143f59417f327f218d0be'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.630877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00d8fd241954fb7b03c33a6b421f4ba', 'request_id': 'req-b73ff273-0959-4dcf-96cd-21cbf1b89399'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.642045 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] The token cache is being invalidate because project b00d8fd241954fb7b03c33a6b421f4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:26.642345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.642962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.644489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1307/2590] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:26 2022] DELETE /identity/v3/projects/b00d8fd241954fb7b03c33a6b421f4ba => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:26.648813 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.650177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.704642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8e47c0ae-bfee-40bc-aa4a-b8da10670f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655d6e49c3a143f59417f327f218d0be'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.712517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ff273-0959-4dcf-96cd-21cbf1b89399 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.717176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.720043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.720043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.720043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] PATH_INFO: `/v3/users/55a1c4bc01ab45babf99d04d9d46b257` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.720043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a1c4bc01ab45babf99d04d9d46b257)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.721718 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.727753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1284/2591] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:26 2022] DELETE /identity/v3/users/655d6e49c3a143f59417f327f218d0be => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:26.728913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.729199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.729475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.747233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:26.748256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.813759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1285/2592] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:26.821237 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:26.822619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:26.880468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e8e2-b53c-4aa3-a738-252d4ad2978a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:26.884788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:26.885424 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:26.885703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:26.885977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:26.894960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:26.896918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:26.906541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1286/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:26.917651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a1c4bc01ab45babf99d04d9d46b257'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.924665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a1c4bc01ab45babf99d04d9d46b257'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:26.928303 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a1c4bc01ab45babf99d04d9d46b257'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.031460 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a1c4bc01ab45babf99d04d9d46b257'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.032112 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a1c4bc01ab45babf99d04d9d46b257'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.049962 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1308/2594] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:26 2022] DELETE /identity/v3/users/55a1c4bc01ab45babf99d04d9d46b257 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:27.338995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.347200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525c0da-d470-4a9b-97df-7aa303aedea3 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.405071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.406581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:27.408439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.409309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.409626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.409909 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] PATH_INFO: `/v3/projects/6de3c795f81c43cea049fdd9ddeded15` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.411149 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de3c795f81c43cea049fdd9ddeded15)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.413151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:27.423844 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1097-5806-4795-ba39-4ccaf71000aa admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.429964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.430961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.431243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.431514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] PATH_INFO: `/v3/projects/bd203cd7c9cb4b0aa36a21c54c098ac1` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.433138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd203cd7c9cb4b0aa36a21c54c098ac1)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.435213 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:27.521048 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de3c795f81c43cea049fdd9ddeded15', 'request_id': 'req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.526391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de3c795f81c43cea049fdd9ddeded15', 'request_id': 'req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.544501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd203cd7c9cb4b0aa36a21c54c098ac1', 'request_id': 'req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.549815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd203cd7c9cb4b0aa36a21c54c098ac1', 'request_id': 'req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.607949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de3c795f81c43cea049fdd9ddeded15', 'request_id': 'req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.619798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] The token cache is being invalidate because project 6de3c795f81c43cea049fdd9ddeded15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:27.620078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.620699 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a347776d-48b6-4cb0-8bbe-cb16f5ec8caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.622299 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1287/2595] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:27 2022] DELETE /identity/v3/projects/6de3c795f81c43cea049fdd9ddeded15 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:27.627010 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bddc-1e35-4e1c-b664-3366261d940c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.627285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bddc-1e35-4e1c-b664-3366261d940c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.627552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bddc-1e35-4e1c-b664-3366261d940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.644761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0685bddc-1e35-4e1c-b664-3366261d940c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:27.649573 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0685bddc-1e35-4e1c-b664-3366261d940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:27.700044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd203cd7c9cb4b0aa36a21c54c098ac1', 'request_id': 'req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.701952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1288/2596] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:27.710390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.710708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.710980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.712342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] The token cache is being invalidate because project bd203cd7c9cb4b0aa36a21c54c098ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:27.712639 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.713290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.714951 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1309/2597] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:27 2022] DELETE /identity/v3/projects/bd203cd7c9cb4b0aa36a21c54c098ac1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:27.721407 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.722948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:27.730974 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:27.732136 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:27.736278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd28cf-ce13-4e86-80fd-cac1de7ebd1f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.740532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1289/2598] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:27.741396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.742294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.742571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.742838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] PATH_INFO: `/v3/users/c33a9e8bb5d54ac89eee339702cee748` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.744024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33a9e8bb5d54ac89eee339702cee748)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.744544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.745967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:27.753347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14ce67-b9ae-499b-8c95-f2ab4728c225 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.758455 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.759089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.759389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.759644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.760362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:27.760666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.762308 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:27.775047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1290/2599] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:27.780211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.789117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4347d1-beeb-40b5-bea8-5803b86a7acf admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.793664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.794315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.794650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.794928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.795627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.797500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:27.904673 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1291/2600] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:27 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:27.905762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:27.913964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33a9e8bb5d54ac89eee339702cee748'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.920838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33a9e8bb5d54ac89eee339702cee748'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.921572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33a9e8bb5d54ac89eee339702cee748'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:27.966750 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a789f3-a8e6-47a2-853a-3063b3a5a9e9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:27.971402 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:27.972152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:27.972439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:27.972716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:27.973397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:27.975373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.059367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33a9e8bb5d54ac89eee339702cee748'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.060041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33a9e8bb5d54ac89eee339702cee748'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.077098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1310/2601] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:27 2022] DELETE /identity/v3/users/c33a9e8bb5d54ac89eee339702cee748 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:28.090371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1292/2602] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:27 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:28.095293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.096724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.161174 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58a95-8068-4532-a60c-af848095113a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.166712 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.167380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.167655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.167926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.168676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.170290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.180013 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1311/2603] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:28.187585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.193897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0ede-b779-4626-b97f-8930852178dd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.198508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.199151 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.199427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.199697 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.200408 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.202040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7728-fde8-4d24-8541-54fca04b484b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.212138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1293/2604] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:28.219337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.229606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b42d-2e72-471d-945a-22c49a81392c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.234232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.235104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.235382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.235649 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] PATH_INFO: `/v3/projects/700fd1ed04724aec981a93668c46bbc3/users/fa6eedfaeb684d50b87facc5423a08d6/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.250884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700fd1ed04724aec981a93668c46bbc3, user_id=fa6eedfaeb684d50b87facc5423a08d6, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.253594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.341183 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1312/2605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:28 2022] PUT /identity/v3/projects/700fd1ed04724aec981a93668c46bbc3/users/fa6eedfaeb684d50b87facc5423a08d6/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:28.352982 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.353505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.353505 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.380053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] MFA Rules not processed for user `fa6eedfaeb684d50b87facc5423a08d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:28.381447 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.451761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1294/2606] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:28.456471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.503152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.508937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.527296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62059c6c-dd29-4175-8d38-921193a02071 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.528931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcd03-a5ed-4c23-9844-7b4217429623 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.535316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.536433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.536687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.537101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.537279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.537542 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] PATH_INFO: `/v3/projects/1b34db1a62f94909929d5a1c224b37cc` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.537686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.537953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.539083 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b34db1a62f94909929d5a1c224b37cc)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.539336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.541384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.541618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.650869 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1313/2607] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:28.654734 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.667570 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b34db1a62f94909929d5a1c224b37cc', 'request_id': 'req-25baca99-cf67-4a6c-a451-3ff7af4c2c47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.673636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b34db1a62f94909929d5a1c224b37cc', 'request_id': 'req-25baca99-cf67-4a6c-a451-3ff7af4c2c47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.725010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391cd0c-a733-4c19-98e8-900834032641 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.758470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b34db1a62f94909929d5a1c224b37cc', 'request_id': 'req-25baca99-cf67-4a6c-a451-3ff7af4c2c47'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.771355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] The token cache is being invalidate because project 1b34db1a62f94909929d5a1c224b37cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:28.774626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.778158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-25baca99-cf67-4a6c-a451-3ff7af4c2c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:28.781913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1295/2608] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:28 2022] DELETE /identity/v3/projects/1b34db1a62f94909929d5a1c224b37cc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:28.782720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.783400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.783546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc827cc-c11b-4a11-a350-0c2c79ebcfbe None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.783742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc827cc-c11b-4a11-a350-0c2c79ebcfbe None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.783873 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.784086 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.784207 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc827cc-c11b-4a11-a350-0c2c79ebcfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.784910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.786953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.815932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-fbc827cc-c11b-4a11-a350-0c2c79ebcfbe None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:28.817124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-fbc827cc-c11b-4a11-a350-0c2c79ebcfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.825820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1296/2609] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:28.833436 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.837650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.837650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.853233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:28.854463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.862409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1297/2610] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:28.866852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.875717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9623e3-978a-46ef-9c76-81a20eb71f5e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.881789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.882483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.882762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.883040 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.883766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:28.884066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.885649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.895643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1314/2611] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:28.900871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1298/2612] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:28.903785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.904193 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.906087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:28.913939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c53e09-5d37-4299-9196-f07dbed5ba3d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.917935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d0bf8-cfd8-466e-8354-f297fedb9ed3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.918885 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.919479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.919765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.920043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.920725 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.922674 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.923946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.924707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.925089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.925462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.926331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.928002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:28.938998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1315/2613] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:28.944425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:28.953953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07575c-b208-4c63-a25b-6c43fb97d291 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:28.958749 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:28.960140 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:28.960420 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:28.960907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] PATH_INFO: `/v3/projects/fb40a37c9dcf4f028ae0352e57486691/users/51281af42d904335870881d2d62ec5f1/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:28.977211 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb40a37c9dcf4f028ae0352e57486691, user_id=51281af42d904335870881d2d62ec5f1, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:28.980817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.042605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1299/2614] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:28 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:29.043553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.095220 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1316/2615] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:28 2022] PUT /identity/v3/projects/fb40a37c9dcf4f028ae0352e57486691/users/51281af42d904335870881d2d62ec5f1/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:29.105724 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b6de-b4c6-4570-8f0b-f6d9f9ef1471 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.106766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.164638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.165350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.165582 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.165838 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.166554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.169942 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091874c-ec1e-408c-ab75-4a3b633c07f4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.174654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.175432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.176165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.176512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.176874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.177675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.179385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.193150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1317/2616] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:29.196210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.203878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871601-6c14-433f-a437-dc913affcf4c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.208660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.210104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.210385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.210670 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] PATH_INFO: `/v3/projects/fb40a37c9dcf4f028ae0352e57486691/users/51281af42d904335870881d2d62ec5f1/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.212613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb40a37c9dcf4f028ae0352e57486691, user_id=51281af42d904335870881d2d62ec5f1, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.215337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9a48-5261-44b3-a52f-4b46b010f22c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.226182 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1318/2617] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:29 2022] PUT /identity/v3/projects/fb40a37c9dcf4f028ae0352e57486691/users/51281af42d904335870881d2d62ec5f1/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:29.236232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.236521 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.236795 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.250051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1300/2618] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:29 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:29.253856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.264476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ee608-ae68-4d57-828c-2e395daa6552 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.269735 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] MFA Rules not processed for user `51281af42d904335870881d2d62ec5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:29.271509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:29.329511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.330212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.330497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.330773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.331499 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.333088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.340442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1319/2619] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:29.345686 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1301/2620] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:29.346541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.352371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.355768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:29.357113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19e2d-b3ce-4baf-bfcd-eabc0ba891da None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.361797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.362482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.362764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.363037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.364137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.366390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.376402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1320/2621] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:29.380613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.390198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f49c00-cc7c-4a8c-bf3d-d322f13fda1a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.394911 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.395769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.396050 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.396317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] PATH_INFO: `/v3/projects/16e6eda36ba44d16b19a9919dc16b55a/users/6331982286fb4680a9095ff63ff31922/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.411241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e6eda36ba44d16b19a9919dc16b55a, user_id=6331982286fb4680a9095ff63ff31922, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.413603 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ce86-58d9-4cca-b106-018dcb8e6bf6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.414560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.418875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.418875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.418875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.418875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.427791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.429791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7c426-aa5c-4066-bf7b-720cede64f76 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.439567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1302/2622] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:29.495232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1321/2623] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:29 2022] PUT /identity/v3/projects/16e6eda36ba44d16b19a9919dc16b55a/users/6331982286fb4680a9095ff63ff31922/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:29.505593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.505874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.506289 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.531981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] MFA Rules not processed for user `6331982286fb4680a9095ff63ff31922`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:29.533147 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:29.598706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1303/2624] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:29.603894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.665448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0f57-5c3b-4281-94d7-0e47fcecf72a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.672624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.673282 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.673563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.673865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.674598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.676497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.777358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1322/2625] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:29 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:29.783463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.795148 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b35708-96ac-46ca-aae0-1de973e40799 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.849980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.851216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.851498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.851772 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.852493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.854437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.957958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1304/2626] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:29 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:29.962447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:29.972680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04218-09b0-4179-ba94-af9c43c434ad admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:29.978108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:29.978814 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:29.979090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:29.979367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:29.980089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:29.981669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:29.994037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1323/2627] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:29.998165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.008753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee69e5-d831-47ff-8720-b40f523dc283 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.013318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.013980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.014323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.014630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.015371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.016997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895cad-756c-46b5-a5aa-c6ba57d03e1f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.030390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1305/2628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:30.033125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.043578 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd333f-eff3-4a40-801d-d6d932e28eed admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.048515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.049403 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.049680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.049953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] PATH_INFO: `/v3/projects/81ce2b3842cb49f7989d15c677e8a9f0/users/6134b1ca69884c3aa2952bf5da5a280c/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.065278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ce2b3842cb49f7989d15c677e8a9f0, user_id=6134b1ca69884c3aa2952bf5da5a280c, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.067997 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.158550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1324/2629] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:30 2022] PUT /identity/v3/projects/81ce2b3842cb49f7989d15c677e8a9f0/users/6134b1ca69884c3aa2952bf5da5a280c/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:30.216102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.216390 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.216667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.243989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] MFA Rules not processed for user `6134b1ca69884c3aa2952bf5da5a280c`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:30.245183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:30.314514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1306/2630] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:30.319511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.356714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.379777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbef0a-e6dc-4001-9c72-f481b4fc45ef admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.384896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.385541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.385819 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.386120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.386800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.388680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.418193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989849-e41b-4a84-ad3f-df847075cba1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.422942 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.423846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.424125 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.424396 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] PATH_INFO: `/v3/users/fa6eedfaeb684d50b87facc5423a08d6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.425595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6eedfaeb684d50b87facc5423a08d6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.427529 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.473196 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1325/2631] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:30 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:30.477285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.539031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e9c4-dfcf-492b-ba15-e3cff1a37f8f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.543930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.544778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.545066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.545348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.546061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.547982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.644193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6eedfaeb684d50b87facc5423a08d6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:30.650835 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6eedfaeb684d50b87facc5423a08d6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:30.651498 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6eedfaeb684d50b87facc5423a08d6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:30.652092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6eedfaeb684d50b87facc5423a08d6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:30.669053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1326/2632] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:30 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:30.670786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.671698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:30.683750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b445-cd74-4870-aee2-fde52d4f75d2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.688361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.688998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.689276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.689551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.690293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.691856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.701957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1327/2633] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:30.705778 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.714630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e78f-11bd-4719-9c26-4e7b875c43bb admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.717261 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f0df304-66b3-48c7-ad2d-6cb6f8528b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6eedfaeb684d50b87facc5423a08d6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:30.719433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.720334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.720613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.720881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] PATH_INFO: `/v3/projects/8c9c225503a844eb8be13d7bf7681979/users/40504eff63aa4acf992a7f6964fac63a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.735647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9c225503a844eb8be13d7bf7681979, user_id=40504eff63aa4acf992a7f6964fac63a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.735877 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1307/2634] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:30 2022] DELETE /identity/v3/users/fa6eedfaeb684d50b87facc5423a08d6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:30.738900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.741677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.741677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.741677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.760761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:30.764777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:30.801750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1328/2635] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:30 2022] PUT /identity/v3/projects/8c9c225503a844eb8be13d7bf7681979/users/40504eff63aa4acf992a7f6964fac63a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:30.806414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.821947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1308/2636] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:30.831888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.833230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:30.874304 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8924-eba5-4ca4-9c80-4c923ca4ba70 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.879079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.879882 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.880163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.880435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.881219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.882867 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.889354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb68e7-ce18-4b87-ae51-a4bbe3a110da None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.892710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1329/2637] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:30.902171 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:30.906908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee8f5-8f61-46d8-8656-2f2b800b0dc7 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:30.911919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.913348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.913732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.914009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] PATH_INFO: `/v3/projects/8c9c225503a844eb8be13d7bf7681979/users/40504eff63aa4acf992a7f6964fac63a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.916262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9c225503a844eb8be13d7bf7681979, user_id=40504eff63aa4acf992a7f6964fac63a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.918955 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e83da-794a-45f3-aa41-3dca61dd98ac admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.929868 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1330/2638] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:30 2022] PUT /identity/v3/projects/8c9c225503a844eb8be13d7bf7681979/users/40504eff63aa4acf992a7f6964fac63a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:30.940109 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:30.940410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.940701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.940831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:30.941004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.941112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:30.941287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:30.950649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:30.952094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:30.961720 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1309/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:30.966788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] MFA Rules not processed for user `40504eff63aa4acf992a7f6964fac63a`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:30.967988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:31.037055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1331/2640] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:31.048709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:31.050212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:31.108971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8827-cc44-464d-ad62-2d7a8900e5f7 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:31.162981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:31.163707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:31.163998 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:31.164274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:31.174595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:31.176107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:31.187878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1310/2641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:31.327689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:31.329082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:31.341270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e5c1d-2913-487f-a211-9d578cec5ca7 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:31.344773 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:31.345401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:31.345677 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:31.345944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:31.347665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:31.353976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:31.355757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:31.411724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:31.413789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:31.422197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6dc2e-4ebe-42a2-8cd2-8da97d583a69 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:31.422723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1332/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:31.427220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:31.430348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:31.430348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:31.430348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] PATH_INFO: `/v3/projects/700fd1ed04724aec981a93668c46bbc3` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:31.430348 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=700fd1ed04724aec981a93668c46bbc3)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:31.431650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:31.569469 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700fd1ed04724aec981a93668c46bbc3', 'request_id': 'req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.574957 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700fd1ed04724aec981a93668c46bbc3', 'request_id': 'req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.626081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700fd1ed04724aec981a93668c46bbc3', 'request_id': 'req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.637814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] The token cache is being invalidate because project 700fd1ed04724aec981a93668c46bbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:31.638126 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.638766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.640345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1311/2643] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:31 2022] DELETE /identity/v3/projects/700fd1ed04724aec981a93668c46bbc3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:31.644412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:31.654964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ab5d-d7f1-4d65-a49d-8d35eedf26ab service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:31.709120 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:31.709972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:31.710275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:31.710541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] PATH_INFO: `/v3/users/51281af42d904335870881d2d62ec5f1` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:31.713503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51281af42d904335870881d2d62ec5f1)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:31.713713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:31.856571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51281af42d904335870881d2d62ec5f1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.863262 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51281af42d904335870881d2d62ec5f1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.863924 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51281af42d904335870881d2d62ec5f1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.973679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51281af42d904335870881d2d62ec5f1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.974435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-dd791953-303e-4602-ad20-2271946ad9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51281af42d904335870881d2d62ec5f1'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:31.993458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1333/2644] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:31 2022] DELETE /identity/v3/users/51281af42d904335870881d2d62ec5f1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:32.444706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:32.446453 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:32.461890 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9761-756b-45c4-a6a7-9fe3f77ee41b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:32.518635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:32.519489 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:32.519767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:32.520037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] PATH_INFO: `/v3/projects/fb40a37c9dcf4f028ae0352e57486691` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:32.521212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb40a37c9dcf4f028ae0352e57486691)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:32.523137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:32.636360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb40a37c9dcf4f028ae0352e57486691', 'request_id': 'req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:32.641507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb40a37c9dcf4f028ae0352e57486691', 'request_id': 'req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:32.740538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb40a37c9dcf4f028ae0352e57486691', 'request_id': 'req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:32.751897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] The token cache is being invalidate because project fb40a37c9dcf4f028ae0352e57486691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:32.752182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:32.752812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-df67c4aa-c1d5-4107-8d0f-54375b8a20fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:32.754480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1312/2645] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:32 2022] DELETE /identity/v3/projects/fb40a37c9dcf4f028ae0352e57486691 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:32.759806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:32.760095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:32.760370 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:32.778898 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:32.780109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:32.836288 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1334/2646] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:32.844497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:32.844791 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:32.845068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:32.863761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:32.865201 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:32.873105 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1313/2647] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:32.877400 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:32.886959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fc3dd-2c8c-4537-83bb-58d8ae6018da None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:32.891541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:32.892180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:32.892458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:32.892725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:32.893541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:32.893836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:32.895447 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:32.907046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1335/2648] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:32.911374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:32.921145 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfd18-1e21-44c6-9c4f-5df7349f424a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:32.925840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:32.926616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:32.926889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:32.927154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:32.927872 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:32.929746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.015236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1314/2649] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:32 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:33.019440 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.029917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec980-5306-487e-b1f1-2010b05e7669 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.085442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.086135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.086416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.086685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.087380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.089276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.090847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.092492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:33.111429 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34cba-33d6-4611-bd15-f456490fd02b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.116331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.117182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.117454 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.117721 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] PATH_INFO: `/v3/users/33116c9aa0394d37ad74a9e174a7e535` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.119493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33116c9aa0394d37ad74a9e174a7e535)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.121432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.194081 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1336/2650] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:33 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:33.195147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.205176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5313ed-7915-41ad-8f8d-dff0226056a2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.210005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.210989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.211272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.211538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.212283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.213881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.224082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1337/2651] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:33.228307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.237699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0388-f323-4f63-be56-bcbb1d67c00a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.242604 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.243235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.244097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.244374 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.245089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.246699 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.256901 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1338/2652] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:33.260802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.270147 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea538-0340-4cc7-9039-0b3128f94c44 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.274782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.275622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.275907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.276180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] PATH_INFO: `/v3/projects/b043623572bb429abe12c5910b4ff71e/users/32fb41b62e1c4cc886d9c0054bf85d4b/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.290067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b043623572bb429abe12c5910b4ff71e, user_id=32fb41b62e1c4cc886d9c0054bf85d4b, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.293258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e101b-d36d-4b43-ab54-14cabbc96274 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.359029 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33116c9aa0394d37ad74a9e174a7e535'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:33.366155 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33116c9aa0394d37ad74a9e174a7e535'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:33.366811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33116c9aa0394d37ad74a9e174a7e535'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:33.370512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33116c9aa0394d37ad74a9e174a7e535'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:33.414664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1339/2653] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:33 2022] PUT /identity/v3/projects/b043623572bb429abe12c5910b4ff71e/users/32fb41b62e1c4cc886d9c0054bf85d4b/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:33.426239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.426527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.426796 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.431684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-29f157ef-11ed-4093-8c27-c168cf00f6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33116c9aa0394d37ad74a9e174a7e535'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:33.453968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1315/2654] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:33 2022] DELETE /identity/v3/users/33116c9aa0394d37ad74a9e174a7e535 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:33.454618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] MFA Rules not processed for user `32fb41b62e1c4cc886d9c0054bf85d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:33.455659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:33.458243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.458595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.458935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.478709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:33.479916 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:33.525616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1340/2655] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:33.528402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.529785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:33.545024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1316/2656] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:33.556221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.557587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:33.596385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3f8d-ca05-46a3-b862-b2e7c82bedd6 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.601652 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.602429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.602815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.603676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.604443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.607529 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.621924 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24931933-25c4-468d-8d0c-4fce87bc9b8a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.625880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.626593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.626873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.627162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.637520 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.639129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.648702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1317/2657] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:33.705316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1341/2658] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:33 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:33.707033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.719746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974af1-8e36-4ba8-a951-3d9bc918f4d3 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.774307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.775565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.775789 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.776057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.776731 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.778644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.873256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1318/2659] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:33 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:33.881051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.891947 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4f1e-38ff-4622-b41f-a72ef17f1424 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.897558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.898261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.898561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.899007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.900381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.901929 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:33.914180 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1342/2660] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:33.918452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:33.930492 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392e9c-bbdf-4d30-87f7-c711b2f842c8 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:33.941459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:33.942365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:33.942644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:33.942915 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] PATH_INFO: `/v3/projects/203e43d2a09e46bd830c946f92a248fa/users/f9142cfcc18a465298de80f89de69ee4/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:33.960089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203e43d2a09e46bd830c946f92a248fa, user_id=f9142cfcc18a465298de80f89de69ee4, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:33.963563 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.021092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1319/2661] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:33 2022] PUT /identity/v3/projects/203e43d2a09e46bd830c946f92a248fa/users/f9142cfcc18a465298de80f89de69ee4/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:34.021638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.024366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.024592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.039973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d087a-6465-4a57-bfd6-ae08d4ae54bf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.096829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c6b49-a6be-4375-8921-558d65fe07d9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.102318 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.103162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.103445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.103723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.104493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.106112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.112570 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.113443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.113724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.114005 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] PATH_INFO: `/v3/projects/6392c3e1cc3c4f0eabba0ad5f0bcedbd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.115610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6392c3e1cc3c4f0eabba0ad5f0bcedbd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.125689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.125805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1320/2662] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:34.125805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.136077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcce279-66ce-4bc1-8c17-07fb6fe7eab6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.141200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.141757 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.142073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.142354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] PATH_INFO: `/v3/projects/203e43d2a09e46bd830c946f92a248fa/users/f9142cfcc18a465298de80f89de69ee4/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.144413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203e43d2a09e46bd830c946f92a248fa, user_id=f9142cfcc18a465298de80f89de69ee4, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.147080 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad54e5-6ed5-4c1c-b6d9-da699fda5a60 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.157350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1321/2663] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:34 2022] PUT /identity/v3/projects/203e43d2a09e46bd830c946f92a248fa/users/f9142cfcc18a465298de80f89de69ee4/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:34.167357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.167649 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.167930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.193787 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] MFA Rules not processed for user `f9142cfcc18a465298de80f89de69ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:34.195024 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.225906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6392c3e1cc3c4f0eabba0ad5f0bcedbd', 'request_id': 'req-93206985-75ef-4b8b-9875-61778dcad915'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:34.232192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6392c3e1cc3c4f0eabba0ad5f0bcedbd', 'request_id': 'req-93206985-75ef-4b8b-9875-61778dcad915'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:34.263920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1322/2664] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:34.274543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.276218 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.306944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6392c3e1cc3c4f0eabba0ad5f0bcedbd', 'request_id': 'req-93206985-75ef-4b8b-9875-61778dcad915'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:34.318698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] The token cache is being invalidate because project 6392c3e1cc3c4f0eabba0ad5f0bcedbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:34.318991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:34.319653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-93206985-75ef-4b8b-9875-61778dcad915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:34.321247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1343/2665] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:34 2022] DELETE /identity/v3/projects/6392c3e1cc3c4f0eabba0ad5f0bcedbd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:34.326777 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0417f-974b-4c27-8122-d93c856f4b1e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.327200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0417f-974b-4c27-8122-d93c856f4b1e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.327576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0417f-974b-4c27-8122-d93c856f4b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.340799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1827b-2225-4d69-b411-6ba06348dd13 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.345919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3cc0417f-974b-4c27-8122-d93c856f4b1e None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:34.347268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3cc0417f-974b-4c27-8122-d93c856f4b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.389762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.390516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.390796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.391087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.392848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.406362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1344/2666] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:34.414428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.414710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.415010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.434241 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:34.435576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.444967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1345/2667] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:34.450044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.456286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.457734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.458753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e2d5b-3be4-43f5-b59f-af367796c49c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.463569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.464244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.464520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.464785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.465503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:34.465801 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.467439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.468009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1323/2668] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:34.482185 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1346/2669] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:34.484204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.495477 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b1ce-e0df-410b-86ab-999a7d0075bb service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.502095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.502095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.502095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.502095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.502511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.504198 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.568546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.570299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.582984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf752-781c-4697-9abe-15d3046536e6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.586799 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.587995 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.588269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.588543 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.590380 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:34.601666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1324/2670] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:34.602679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.649347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.651484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.660998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1347/2671] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:34.663774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2d03-8b08-4732-b2c1-97464f9bcb79 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.668929 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.669599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.669882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.670193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.670882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.672833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.746375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1325/2672] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:34.750462 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.761851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aee81-5106-4be9-a054-57152cd80643 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.766656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.767306 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.767664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.767935 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.768653 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.770264 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.780937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1348/2673] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:34.784925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.794945 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c359a-d331-4dcb-aeac-db8c748d25d2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.799966 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.804107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.804107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.804107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.804107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.804107 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0d67-e22a-4b2e-8b00-ace96ddc471f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.813536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1326/2674] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:34.817704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:34.827963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc80f5-5537-4abf-b4f6-3db94b218d71 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:34.832498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:34.833362 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.833629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.833938 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] PATH_INFO: `/v3/projects/4524739bdc2e4a7e9fa4b720816e5650/users/8e2c795c2940420cbed0579cef88c2c6/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.848807 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4524739bdc2e4a7e9fa4b720816e5650, user_id=8e2c795c2940420cbed0579cef88c2c6, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:34.851473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:34.911622 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1349/2675] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:34 2022] PUT /identity/v3/projects/4524739bdc2e4a7e9fa4b720816e5650/users/8e2c795c2940420cbed0579cef88c2c6/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:34.923479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:34.923794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:34.924077 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:34.952871 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] MFA Rules not processed for user `8e2c795c2940420cbed0579cef88c2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:34.954117 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.028805 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1327/2676] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:35.033443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.094305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6a158-983a-468e-b80d-13b80335b80e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.099075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.099733 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.100024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.100302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.101035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.102989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.205577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1350/2677] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:35 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:35.209373 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.219865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ace9df-564c-4b98-9895-b48c9c87364f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.277827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.278622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.278972 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.279251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.279706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.279954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.281412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.281875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.294583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a19aa-915a-48da-a85f-e5ad2e5f5c9d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.299298 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.300154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.300467 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.300878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] PATH_INFO: `/v3/users/6331982286fb4680a9095ff63ff31922` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.302137 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6331982286fb4680a9095ff63ff31922)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.304030 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.363561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1328/2678] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:35 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:35.369189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.378730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c07fa-cfd5-4c91-aadb-63fc007c1621 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.383565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.384262 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.384546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.384815 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.385538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.388551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.398846 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1329/2679] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:35.402800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.412364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530931d-346f-41f1-814a-ce0c40afa3b9 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.417536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.418471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.418752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.419019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] PATH_INFO: `/v3/projects/e713e98ac8c94829afa6a0850bd62829/users/8d51059f6915423c9ec491b659c110cd/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.435134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e713e98ac8c94829afa6a0850bd62829, user_id=8d51059f6915423c9ec491b659c110cd, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.437869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.479592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6331982286fb4680a9095ff63ff31922'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:35.486279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6331982286fb4680a9095ff63ff31922'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:35.486953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6331982286fb4680a9095ff63ff31922'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:35.523236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1330/2680] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:35 2022] PUT /identity/v3/projects/e713e98ac8c94829afa6a0850bd62829/users/8d51059f6915423c9ec491b659c110cd/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:35.527013 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.528641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.586041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6331982286fb4680a9095ff63ff31922'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:35.586760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-b4aa9ba0-afdc-4e75-8fdc-0ab9ca35cc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6331982286fb4680a9095ff63ff31922'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:35.591334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5edaf7-ad89-4816-8b67-68b9c8a93a6a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.596037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.596628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.596906 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.597183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.597902 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.599519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.606507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1351/2681] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:35 2022] DELETE /identity/v3/users/6331982286fb4680a9095ff63ff31922 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:35.613176 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1331/2682] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:35.613387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.613387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.613387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.615067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.629193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd7d9-a28d-407d-89c0-05dee9260d2a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.631381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:35.632918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.694203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.695108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.695385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.695656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] PATH_INFO: `/v3/projects/e713e98ac8c94829afa6a0850bd62829/users/8d51059f6915423c9ec491b659c110cd/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.696551 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1352/2683] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:35.697609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e713e98ac8c94829afa6a0850bd62829, user_id=8d51059f6915423c9ec491b659c110cd, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.700676 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdfa6d-e2ec-46e0-a192-07311ecfcdd0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.706571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.707917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.711090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1332/2684] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:35 2022] PUT /identity/v3/projects/e713e98ac8c94829afa6a0850bd62829/users/8d51059f6915423c9ec491b659c110cd/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:35.724157 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.724452 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.724711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.752653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] MFA Rules not processed for user `8d51059f6915423c9ec491b659c110cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:35.753880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.764621 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae30cc-9b6c-427d-bf86-b2f7a91f866b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.813994 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.814662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.814934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.815202 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.821076 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1333/2685] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:35.832212 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:35.833672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:35.875573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.877083 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.887279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1353/2686] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:35.890589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586bda1-994a-4bc8-b660-2eb6a4e601d8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:35.894321 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:35.895064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:35.895345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:35.895669 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:35.905821 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:35.907394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:35.917472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1334/2687] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:36.097881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:36.107643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107d6b-56e2-4933-8c48-2cdabaeaf845 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:36.111311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:36.111941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:36.112215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:36.112486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:36.114665 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:36.172382 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:36.173894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:36.183079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1354/2688] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:36.251199 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:36.252496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:36.281025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534ce2-6c08-4f0f-b68c-ce1b7b13db3e service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:36.282797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:36.283925 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:36.284411 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:36.284814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] PATH_INFO: `/v3/projects/16e6eda36ba44d16b19a9919dc16b55a` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:36.286139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e6eda36ba44d16b19a9919dc16b55a)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:36.288234 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:36.415903 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e6eda36ba44d16b19a9919dc16b55a', 'request_id': 'req-5b85a8f8-de7b-4545-975a-931e15b3c900'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.421165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e6eda36ba44d16b19a9919dc16b55a', 'request_id': 'req-5b85a8f8-de7b-4545-975a-931e15b3c900'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.505671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e6eda36ba44d16b19a9919dc16b55a', 'request_id': 'req-5b85a8f8-de7b-4545-975a-931e15b3c900'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.517416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] The token cache is being invalidate because project 16e6eda36ba44d16b19a9919dc16b55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:36.517703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.518375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.520031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1335/2689] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:36 2022] DELETE /identity/v3/projects/16e6eda36ba44d16b19a9919dc16b55a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:36.524206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:36.535336 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca29f0-1d46-4c4e-9648-ec7f5259186f service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:36.591223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:36.592070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:36.592345 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:36.592615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] PATH_INFO: `/v3/users/6134b1ca69884c3aa2952bf5da5a280c` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:36.593800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6134b1ca69884c3aa2952bf5da5a280c)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:36.602385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:36.799328 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6134b1ca69884c3aa2952bf5da5a280c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.806215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6134b1ca69884c3aa2952bf5da5a280c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.806897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6134b1ca69884c3aa2952bf5da5a280c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.888851 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6134b1ca69884c3aa2952bf5da5a280c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.889412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6134b1ca69884c3aa2952bf5da5a280c'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:36.907300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1355/2690] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:36 2022] DELETE /identity/v3/users/6134b1ca69884c3aa2952bf5da5a280c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:37.344236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:37.345797 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:37.359607 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85a8f8-de7b-4545-975a-931e15b3c900 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:37.417983 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:37.418824 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:37.419090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:37.419364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] PATH_INFO: `/v3/projects/81ce2b3842cb49f7989d15c677e8a9f0` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:37.420531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ce2b3842cb49f7989d15c677e8a9f0)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:37.422458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:37.511386 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ce2b3842cb49f7989d15c677e8a9f0', 'request_id': 'req-c49765db-e65b-413e-9f22-fef79c0d5efe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.516705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ce2b3842cb49f7989d15c677e8a9f0', 'request_id': 'req-c49765db-e65b-413e-9f22-fef79c0d5efe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.579977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ce2b3842cb49f7989d15c677e8a9f0', 'request_id': 'req-c49765db-e65b-413e-9f22-fef79c0d5efe'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.591642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] The token cache is being invalidate because project 81ce2b3842cb49f7989d15c677e8a9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:37.594164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.594164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.595281 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1336/2691] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:37 2022] DELETE /identity/v3/projects/81ce2b3842cb49f7989d15c677e8a9f0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:37.599538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:37.601007 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:37.614609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18d42-83d0-437b-99f7-a9fc2df91478 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:37.677950 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:37.681478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:37.681478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:37.681478 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] PATH_INFO: `/v3/users/40504eff63aa4acf992a7f6964fac63a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:37.682078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40504eff63aa4acf992a7f6964fac63a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:37.686502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:37.686502 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:37.686954 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:37.698626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765db-e65b-413e-9f22-fef79c0d5efe admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:37.704306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:37.705177 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:37.705627 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:37.706097 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] PATH_INFO: `/v3/users/32fb41b62e1c4cc886d9c0054bf85d4b` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:37.707572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fb41b62e1c4cc886d9c0054bf85d4b)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:37.710272 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:37.885028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40504eff63aa4acf992a7f6964fac63a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.891753 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40504eff63aa4acf992a7f6964fac63a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.892410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40504eff63aa4acf992a7f6964fac63a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.918254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fb41b62e1c4cc886d9c0054bf85d4b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.925088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fb41b62e1c4cc886d9c0054bf85d4b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.925668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fb41b62e1c4cc886d9c0054bf85d4b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.926296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fb41b62e1c4cc886d9c0054bf85d4b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.958485 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40504eff63aa4acf992a7f6964fac63a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.959104 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-ece23626-2894-4366-85f9-c32823634125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40504eff63aa4acf992a7f6964fac63a'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:37.982289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1356/2692] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:37 2022] DELETE /identity/v3/users/40504eff63aa4acf992a7f6964fac63a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:38.025794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fb41b62e1c4cc886d9c0054bf85d4b'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.044163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1337/2693] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:37 2022] DELETE /identity/v3/users/32fb41b62e1c4cc886d9c0054bf85d4b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:38.048742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.049042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.049310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.067277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:38.068474 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.130292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1357/2694] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:38.140554 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.141937 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.204187 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93449f6b-a390-48c8-9281-0709a5343031 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:38.207784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:38.211664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.211664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.211664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.218282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:38.219917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fabceb-4c68-401d-81b1-8077ee425ec0 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:38.230122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1338/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:38.405259 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.418330 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.419630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f76caa-686c-4d7d-aa28-488a3e940c58 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:38.424504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:38.425435 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.425797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.426176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] PATH_INFO: `/v3/projects/8c9c225503a844eb8be13d7bf7681979` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.427512 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9c225503a844eb8be13d7bf7681979)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:38.429894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:38.529356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9c225503a844eb8be13d7bf7681979', 'request_id': 'req-2051b028-2665-4df8-afc2-9da0088b5689'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.535139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9c225503a844eb8be13d7bf7681979', 'request_id': 'req-2051b028-2665-4df8-afc2-9da0088b5689'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.603044 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9c225503a844eb8be13d7bf7681979', 'request_id': 'req-2051b028-2665-4df8-afc2-9da0088b5689'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.614737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] The token cache is being invalidate because project 8c9c225503a844eb8be13d7bf7681979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:38.615024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.615643 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.617177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1358/2696] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:38 2022] DELETE /identity/v3/projects/8c9c225503a844eb8be13d7bf7681979 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:38.623781 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1237-9bbd-45dc-b93b-5b2bbce29e46 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.624241 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1237-9bbd-45dc-b93b-5b2bbce29e46 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.624435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1237-9bbd-45dc-b93b-5b2bbce29e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.643102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-3cec1237-9bbd-45dc-b93b-5b2bbce29e46 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:38.644267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3cec1237-9bbd-45dc-b93b-5b2bbce29e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.656348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.658234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.705995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1339/2697] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:38.715820 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.716110 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.716387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.727341 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051b028-2665-4df8-afc2-9da0088b5689 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:38.732861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:38.733716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.736965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.736965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] PATH_INFO: `/v3/projects/b043623572bb429abe12c5910b4ff71e` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.737349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:38.737458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b043623572bb429abe12c5910b4ff71e)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:38.737569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:38.737672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:38.744531 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1340/2698] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:38.748705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.757382 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f125-ec64-4c48-8af0-993a7119ccb8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:38.761911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:38.762615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.762898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.763173 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.763892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:38.764192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:38.765760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:38.778752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1341/2699] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:38.783140 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.793266 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a18b-0dc6-461f-adb5-6f033597b269 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:38.798092 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:38.798722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:38.799003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:38.799276 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:38.799958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:38.801834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:38.866244 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b043623572bb429abe12c5910b4ff71e', 'request_id': 'req-67edf149-1f29-498a-affb-dec3698bade3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.871544 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b043623572bb429abe12c5910b4ff71e', 'request_id': 'req-67edf149-1f29-498a-affb-dec3698bade3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.913150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1342/2700] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:38 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:38.917997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:38.964325 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b043623572bb429abe12c5910b4ff71e', 'request_id': 'req-67edf149-1f29-498a-affb-dec3698bade3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:38.976363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] The token cache is being invalidate because project b043623572bb429abe12c5910b4ff71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:39.003225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.003225 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.003474 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc465f-0497-499e-ab1a-af9daf14c3c5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.003587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1359/2701] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:38 2022] DELETE /identity/v3/projects/b043623572bb429abe12c5910b4ff71e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:39.003587 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.003819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.003819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.003819 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.004128 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:39.004246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.004246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.004246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.048102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf149-1f29-498a-affb-dec3698bade3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.052864 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.053725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.054004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.054331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] PATH_INFO: `/v3/users/f9142cfcc18a465298de80f89de69ee4` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.055528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9142cfcc18a465298de80f89de69ee4)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.057461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.106623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1343/2702] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:38 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:39.110667 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.112188 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:39.124204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aaa2e-9352-47e5-9faf-7f5a382b2509 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.128994 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.129677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.135406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.135406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.135406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.135406 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.142965 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1344/2703] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:39.146530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.156371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c4ddc-d1bf-485e-ac4b-8317d1164698 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.160907 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.167002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.167002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.167002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.167002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.167002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.174353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1345/2704] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:39.178179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.191631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf96b-55ae-4f47-98d3-8e4047b170f7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.196332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.198516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.198516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.198516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] PATH_INFO: `/v3/projects/6d84dd83e70649c2a39dba2a7f579edf/users/e8f152c666904ca8996b903149e35322/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.214829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d84dd83e70649c2a39dba2a7f579edf, user_id=e8f152c666904ca8996b903149e35322, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.217388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909879f4-a893-4039-a640-335f39da6d12 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.255680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9142cfcc18a465298de80f89de69ee4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.262724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9142cfcc18a465298de80f89de69ee4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.263386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9142cfcc18a465298de80f89de69ee4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.340305 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1346/2705] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:39 2022] PUT /identity/v3/projects/6d84dd83e70649c2a39dba2a7f579edf/users/e8f152c666904ca8996b903149e35322/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:39.351996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.352307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.352581 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.363087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9142cfcc18a465298de80f89de69ee4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.363784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9142cfcc18a465298de80f89de69ee4'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:39.385781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1360/2706] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:38 2022] DELETE /identity/v3/users/f9142cfcc18a465298de80f89de69ee4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:39.386539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] MFA Rules not processed for user `e8f152c666904ca8996b903149e35322`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:39.386539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:39.462675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1347/2707] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:39.475040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.476899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:39.561890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807041b7-fdcc-458e-bf7a-791d5682f907 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.565860 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a21a1e87b44b35a3c82c69830b3b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.566549 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.566834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.567111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.585482 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.588446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a056-c227-448e-924f-90aa8e3ddc3e service glance] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:39.603127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1361/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:39.846651 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:39.848417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:39.934189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e9ece-8656-4c2b-abe8-6324374f8891 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:39.940300 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:39.943422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:39.943422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:39.943422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] PATH_INFO: `/v3/projects/203e43d2a09e46bd830c946f92a248fa` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:39.943422 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203e43d2a09e46bd830c946f92a248fa)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:39.945008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.084655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203e43d2a09e46bd830c946f92a248fa', 'request_id': 'req-732577b5-70a6-40f2-bd70-1fb0052e8cd9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:40.090675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203e43d2a09e46bd830c946f92a248fa', 'request_id': 'req-732577b5-70a6-40f2-bd70-1fb0052e8cd9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:40.191625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203e43d2a09e46bd830c946f92a248fa', 'request_id': 'req-732577b5-70a6-40f2-bd70-1fb0052e8cd9'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:40.203802 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] The token cache is being invalidate because project 203e43d2a09e46bd830c946f92a248fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:40.204089 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:40.204728 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-732577b5-70a6-40f2-bd70-1fb0052e8cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:40.206317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1348/2709] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:39 2022] DELETE /identity/v3/projects/203e43d2a09e46bd830c946f92a248fa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:40.211141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.211431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.211706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.230571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:40.231742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:40.288397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1362/2710] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:40.297004 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.297284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.297575 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.321986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:40.321986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:40.328594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1349/2711] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:40.334272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.344456 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b423929-6036-45ac-bc03-30a0604406f5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.350769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.350769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.350769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.350769 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.351233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:40.351233 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.353433 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.364926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1363/2712] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:40.369204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.378421 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd413-80a6-41eb-b2a8-1db9a354a730 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.383347 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.384008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.384286 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.384551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.385227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.387178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.521165 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1350/2713] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:40.525002 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.536095 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d1b0-9d6f-4fa4-a627-7af74e00e5cb admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.597124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.597989 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.598301 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.598571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.599263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.601168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.672031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1364/2714] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:40.676267 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.686878 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c808-a73d-48f7-91c1-00e5c079829b admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.691539 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.692154 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.692432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.692703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.693426 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.695392 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.705254 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1351/2715] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:40.709315 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.719110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7708-cec9-4994-b2aa-c7e1a3fbc8d4 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.723632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.724278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.724553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.724828 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.725547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.727192 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2692a19-0b0d-4041-b040-74802e461fe1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.737784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1365/2716] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:40.742156 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:40.752644 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd284a-223c-48c2-a0c7-da982575ec34 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:40.757327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:40.758230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.758508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.758780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] PATH_INFO: `/v3/projects/9be54cda283149f4be7bea84c0ee294c/users/061eac7d15a541f89a428cbebed5f558/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.772962 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be54cda283149f4be7bea84c0ee294c, user_id=061eac7d15a541f89a428cbebed5f558, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:40.775684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:40.830599 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1352/2717] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:40 2022] PUT /identity/v3/projects/9be54cda283149f4be7bea84c0ee294c/users/061eac7d15a541f89a428cbebed5f558/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:40.888897 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:40.889175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:40.889445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:40.919445 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] MFA Rules not processed for user `061eac7d15a541f89a428cbebed5f558`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:40.920638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:40.981676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1366/2718] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:40.986185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.045938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5d90-a059-44ba-9156-e6c7afd42c41 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.050450 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.051085 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.051361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.051630 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.052314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.054278 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.130419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1353/2719] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:40 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:41.134479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.145061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ca387-a751-4604-9ac5-ba47ed24a375 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.198859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.199515 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.199793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.200064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.200737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.202673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.278894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1367/2720] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:41 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:41.283124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.293541 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40605c9-2c0d-44b5-b105-15b403264f64 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.298324 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.298979 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.299260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.299535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.300285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.301875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.315825 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1354/2721] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:41.316982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.327396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6647a-344a-4bd7-b7fa-2a100eedd136 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.331933 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.332800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.333072 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.333337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] PATH_INFO: `/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c/users/36471320d9fe44fc93a4732d9f6413ce/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.348310 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91c20ab16c4de0908a499e1fa64d6c, user_id=36471320d9fe44fc93a4732d9f6413ce, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.350982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.404811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1368/2722] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:41 2022] PUT /identity/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c/users/36471320d9fe44fc93a4732d9f6413ce/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:41.408851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.419410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702709-d868-4f52-b012-b63f07d4a49a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.477526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.478353 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.478506 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.478776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.479532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.481175 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bbc5e-ad50-4f85-9633-9cb6848a7ba6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.491960 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1355/2723] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:41.496210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.507103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db50028-1f5d-4d94-bd5e-4b360bea1fd1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.512569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.513595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.514896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.514896 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] PATH_INFO: `/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c/users/36471320d9fe44fc93a4732d9f6413ce/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.516319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91c20ab16c4de0908a499e1fa64d6c, user_id=36471320d9fe44fc93a4732d9f6413ce, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.518984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.530373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1369/2724] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:41 2022] PUT /identity/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c/users/36471320d9fe44fc93a4732d9f6413ce/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:41.540735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.541025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.541480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.571226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] MFA Rules not processed for user `36471320d9fe44fc93a4732d9f6413ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:41.572977 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:41.642043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1356/2725] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:41.653423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.655172 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:41.711513 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766112-1171-498d-98e1-224b2fda3534 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.715195 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.715822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.716102 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.716375 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:41.725452 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:41.726906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:41.736272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1370/2726] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:41.978990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:41.988377 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3d286-3445-46a8-aa7b-70431b887f88 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:41.992228 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:41.992859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:41.997143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:41.997143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:42.047495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:42.048932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:42.058183 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1357/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:48.187080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:48.188480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:48.245857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:48.253401 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368983-9f13-4afe-899a-30d06226844c service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:48.257941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:48.258912 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.259191 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.259464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] PATH_INFO: `/v3/users/8e2c795c2940420cbed0579cef88c2c6` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.260729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2c795c2940420cbed0579cef88c2c6)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:48.260995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0e8a-a6d9-4cd0-9b89-22c6ee20f276 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:48.263346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:48.266590 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:48.267460 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.267736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.268007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] PATH_INFO: `/v3/users/061eac7d15a541f89a428cbebed5f558` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.269195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] RBAC: Authorizing `identity:delete_user(user_id=061eac7d15a541f89a428cbebed5f558)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:48.271146 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:48.411840 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2c795c2940420cbed0579cef88c2c6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.422393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2c795c2940420cbed0579cef88c2c6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.423105 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2c795c2940420cbed0579cef88c2c6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.429884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061eac7d15a541f89a428cbebed5f558'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.437069 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061eac7d15a541f89a428cbebed5f558'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.437833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061eac7d15a541f89a428cbebed5f558'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.438461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061eac7d15a541f89a428cbebed5f558'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.500646 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2c795c2940420cbed0579cef88c2c6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.501367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c538bbc0-3e8d-47a9-b3bc-f46da7504bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2c795c2940420cbed0579cef88c2c6'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.519616 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1371/2728] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:48 2022] DELETE /identity/v3/users/8e2c795c2940420cbed0579cef88c2c6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:48.524069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.524358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.524635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.541683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:48.542899 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:48.545952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-646a1e69-fa7e-4ea5-b1fb-04081fe1428f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061eac7d15a541f89a428cbebed5f558'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:48.564912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1358/2729] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:48 2022] DELETE /identity/v3/users/061eac7d15a541f89a428cbebed5f558 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:48.569481 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.569765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.570056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.588948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:48.590180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:48.604222 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1372/2730] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:48.613811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:48.615442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:48.649518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1359/2731] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:48.666470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:48.666470 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:48.677152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701538f9-08a9-40d5-a7be-c0be12a171e1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:48.724256 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a30167-8e1b-486b-9cac-8f6562ea44d8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:48.725706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:48.726387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.726669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.726944 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.728388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:48.729033 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:48.729316 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:48.729588 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:48.736571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:48.738048 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:48.739413 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:48.741142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:48.750527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1373/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:48.756084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1360/2733] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:49.262383 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:49.263932 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:49.284365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:49.286363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e5688-d098-4819-bfd8-ce88fdf06105 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:49.291290 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:49.298245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:49.299179 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:49.299373 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:49.299635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] PATH_INFO: `/v3/projects/4524739bdc2e4a7e9fa4b720816e5650` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:49.301028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4524739bdc2e4a7e9fa4b720816e5650)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:49.303131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:49.307776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ecf83-a72f-492a-b12c-a80a015cdd3a service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:49.314243 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:49.315096 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:49.315395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:49.315740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] PATH_INFO: `/v3/projects/9be54cda283149f4be7bea84c0ee294c` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:49.317653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be54cda283149f4be7bea84c0ee294c)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:49.319032 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:49.420629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4524739bdc2e4a7e9fa4b720816e5650', 'request_id': 'req-3f36732d-4930-423c-a7e6-cc3a60d71afc'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.426672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4524739bdc2e4a7e9fa4b720816e5650', 'request_id': 'req-3f36732d-4930-423c-a7e6-cc3a60d71afc'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.428169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be54cda283149f4be7bea84c0ee294c', 'request_id': 'req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.433763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be54cda283149f4be7bea84c0ee294c', 'request_id': 'req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.489227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4524739bdc2e4a7e9fa4b720816e5650', 'request_id': 'req-3f36732d-4930-423c-a7e6-cc3a60d71afc'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.501074 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] The token cache is being invalidate because project 4524739bdc2e4a7e9fa4b720816e5650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:49.501348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.502069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.503631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1374/2734] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:49 2022] DELETE /identity/v3/projects/4524739bdc2e4a7e9fa4b720816e5650 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:49.507536 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:49.508948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:49.557313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be54cda283149f4be7bea84c0ee294c', 'request_id': 'req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.568793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] The token cache is being invalidate because project 9be54cda283149f4be7bea84c0ee294c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:49.571836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.571836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.571836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1361/2735] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:49 2022] DELETE /identity/v3/projects/9be54cda283149f4be7bea84c0ee294c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:49.575680 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:49.576595 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36732d-4930-423c-a7e6-cc3a60d71afc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:49.577018 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:49.633071 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:49.633972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:49.634283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:49.634561 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] PATH_INFO: `/v3/users/8d51059f6915423c9ec491b659c110cd` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:49.635812 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d51059f6915423c9ec491b659c110cd)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:49.638299 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:49.642786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52914-fcf0-49fd-97e3-085aa6ae42c8 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:49.647298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:49.648138 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:49.648417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:49.648684 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] PATH_INFO: `/v3/users/36471320d9fe44fc93a4732d9f6413ce` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:49.649866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=36471320d9fe44fc93a4732d9f6413ce)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:49.651774 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:49.840850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36471320d9fe44fc93a4732d9f6413ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.843413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d51059f6915423c9ec491b659c110cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.847826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36471320d9fe44fc93a4732d9f6413ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.851931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36471320d9fe44fc93a4732d9f6413ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.851931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36471320d9fe44fc93a4732d9f6413ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.852169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d51059f6915423c9ec491b659c110cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.852169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d51059f6915423c9ec491b659c110cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.928917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36471320d9fe44fc93a4732d9f6413ce'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.946632 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1362/2736] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:49 2022] DELETE /identity/v3/users/36471320d9fe44fc93a4732d9f6413ce => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:49.980285 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d51059f6915423c9ec491b659c110cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:49.981631 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d51059f6915423c9ec491b659c110cd'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.003014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1375/2737] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:49 2022] DELETE /identity/v3/users/8d51059f6915423c9ec491b659c110cd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:50.399116 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.400698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.422657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.426545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.480713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39feb3e-0466-499c-81b1-4099ec1226dd admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.500895 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fb350-e886-48e7-9192-32bd5c111321 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.505547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.506439 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.506838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.507119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] PATH_INFO: `/v3/projects/e713e98ac8c94829afa6a0850bd62829` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.508309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e713e98ac8c94829afa6a0850bd62829)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.510393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.538417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.539282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.539561 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.539833 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] PATH_INFO: `/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.541030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f91c20ab16c4de0908a499e1fa64d6c)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.543001 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.613742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e713e98ac8c94829afa6a0850bd62829', 'request_id': 'req-0b692c60-2ab5-4d31-8447-f19190d0ebb5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.619255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e713e98ac8c94829afa6a0850bd62829', 'request_id': 'req-0b692c60-2ab5-4d31-8447-f19190d0ebb5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.671763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f91c20ab16c4de0908a499e1fa64d6c', 'request_id': 'req-0f20fb86-1d34-4c76-b453-c37525c01e7d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.678115 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f91c20ab16c4de0908a499e1fa64d6c', 'request_id': 'req-0f20fb86-1d34-4c76-b453-c37525c01e7d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.683251 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e713e98ac8c94829afa6a0850bd62829', 'request_id': 'req-0b692c60-2ab5-4d31-8447-f19190d0ebb5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.696056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] The token cache is being invalidate because project e713e98ac8c94829afa6a0850bd62829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:50.696342 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.696988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-0b692c60-2ab5-4d31-8447-f19190d0ebb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.700633 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1376/2738] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:50 2022] DELETE /identity/v3/projects/e713e98ac8c94829afa6a0850bd62829 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:50.704053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc347-695e-42c5-8150-25f827f7fbd0 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.704337 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc347-695e-42c5-8150-25f827f7fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.704609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc347-695e-42c5-8150-25f827f7fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.725459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-9eacc347-695e-42c5-8150-25f827f7fbd0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:50.726770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9eacc347-695e-42c5-8150-25f827f7fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.752134 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f91c20ab16c4de0908a499e1fa64d6c', 'request_id': 'req-0f20fb86-1d34-4c76-b453-c37525c01e7d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.764233 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] The token cache is being invalidate because project 6f91c20ab16c4de0908a499e1fa64d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:50.764512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.765163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0f20fb86-1d34-4c76-b453-c37525c01e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:50.766716 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1363/2739] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:50 2022] DELETE /identity/v3/projects/6f91c20ab16c4de0908a499e1fa64d6c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:50.771514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238835e-70e2-476c-a3a4-b1a5c9b8cee2 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.771514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238835e-70e2-476c-a3a4-b1a5c9b8cee2 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.771753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238835e-70e2-476c-a3a4-b1a5c9b8cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.789958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-0238835e-70e2-476c-a3a4-b1a5c9b8cee2 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:50.791185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0238835e-70e2-476c-a3a4-b1a5c9b8cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.792018 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1377/2740] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:50.799664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1364/2741] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:50.799875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.800199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.800459 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.807857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.808141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.808415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.819127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:50.820331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.829437 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:50.830698 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:50.832571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1378/2742] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:50.836603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.838708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1365/2743] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:50.842557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.846121 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9baf-111a-4c07-b840-fcefdaf5f6cf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.851019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.851322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625069-acd6-4c56-94c0-714d5d4eba66 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.851651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.851930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.852197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.852919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:50.853218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.855754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.856532 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.857312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.857681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.858002 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.858748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:50.859142 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.863124 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.869424 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1379/2744] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:50.876912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1366/2745] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:31:50.877076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.877810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.885143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ffa0-b362-45cd-8145-04f5de086de2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.888332 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3d22-d554-47d6-a15c-33d14a8521d7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:50.892127 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.892783 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.893061 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.893180 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:50.897818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.897949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:50.898099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.898216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:50.898216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:50.898216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:50.898471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.898569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:50.966087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1380/2746] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:50.969876 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:50.981623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1367/2747] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:50.981869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.038520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2f0b-f8b2-4f47-8608-873adbfd9e89 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.056328 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e02c-7d53-42d4-ac55-f23776530cfb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.062050 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.062752 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.063035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.063309 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.064016 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.065986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.103676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.104389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.104744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.105077 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.105875 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.108369 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.147376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1368/2748] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:51.151355 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.160996 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d71ef-8e14-4f36-974c-f7fc5f7dfe98 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.165631 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.166307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.166584 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.166852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.167556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.169682 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.179255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1369/2749] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:51.182941 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.193317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380b80-cc55-4235-b681-2f19e2a3a164 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.197986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.198671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.198946 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.199213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.199956 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.201569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.205356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1381/2750] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:50 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:51.208438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.212259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1370/2751] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:51.216315 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.218484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df9446-09db-464b-8bbc-74c0811b797b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.223160 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.223808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.224089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.224376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.225084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.226051 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3c46-c369-42bf-977a-ad614431312c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.226846 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.231953 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.233049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.233354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.233634 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] PATH_INFO: `/v3/projects/6b28888a4f2c45c5b1b2b4ecdf69c978/users/d62c0afc301a44f884e35677cd3f0cc8/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.241676 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1382/2752] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:51.242871 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.250409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b28888a4f2c45c5b1b2b4ecdf69c978, user_id=d62c0afc301a44f884e35677cd3f0cc8, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.253103 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649825-14d9-42ef-a442-ba551341fcad admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.253240 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029b8b-36bd-42ad-b395-8feebf1eefd8 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.257716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.258377 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.258655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.258921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.259663 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.261218 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.274557 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1383/2753] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:51.279629 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.289886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6d33-443a-4f3f-8d53-0e364899e010 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.295167 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.296039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.296314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.296584 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] PATH_INFO: `/v3/projects/271395157d134a7f916d12ba8baea859/users/1ef4990c336444b6bd932baa29295bd6/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.310535 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=271395157d134a7f916d12ba8baea859, user_id=1ef4990c336444b6bd932baa29295bd6, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.313162 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f72ef-6828-481e-928b-1332c0a71b1e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.323108 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1371/2754] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:51 2022] PUT /identity/v3/projects/6b28888a4f2c45c5b1b2b4ecdf69c978/users/d62c0afc301a44f884e35677cd3f0cc8/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:51.333101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.333357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.333638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.364331 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] MFA Rules not processed for user `d62c0afc301a44f884e35677cd3f0cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:51.365807 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:51.409428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1384/2755] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:51 2022] PUT /identity/v3/projects/271395157d134a7f916d12ba8baea859/users/1ef4990c336444b6bd932baa29295bd6/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:51.421332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.421625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.421903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.432545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1372/2756] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:51.453028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] MFA Rules not processed for user `1ef4990c336444b6bd932baa29295bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:51.454266 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:51.464834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.466851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:51.520280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1385/2757] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:51.524716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.524943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a9d3-a447-48a0-b421-87018e2d7e48 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.575463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.576111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.576385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.576655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.586910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0363-4f40-46f8-89f5-84833934a07c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.592076 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.592732 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.593038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.593438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.594169 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.596094 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.635619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.637064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.646829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1373/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:51.661057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.671458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4e33-67e1-469e-b4df-f455c55bd140 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.676278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1386/2759] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:51 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:51.677252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.731091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.731866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.732144 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.732416 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] PATH_INFO: `/v3/users/d62c0afc301a44f884e35677cd3f0cc8` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.733614 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62c0afc301a44f884e35677cd3f0cc8)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.735571 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.739607 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9808d8-9115-4378-8063-e50f38494b0e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.744429 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.745175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.745475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.745822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.746555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.750134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.854664 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1387/2760] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:51 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:51.858863 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.869115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b35ec-daec-4b65-ab71-8837598b44f2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.873701 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.874398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.874675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.874948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.875671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.877255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.887049 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1388/2761] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:51.891780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:51.901625 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0d976-25a6-4872-887d-a2a5ed035b65 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:51.906918 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:51.907781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:51.908062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:51.908332 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] PATH_INFO: `/v3/projects/277d7b32a4f448c8bf91e0410b0572ac/users/c030ef0e10fa41ee89824602f2207d09/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:51.923226 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277d7b32a4f448c8bf91e0410b0572ac, user_id=c030ef0e10fa41ee89824602f2207d09, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:51.925886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:51.948112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62c0afc301a44f884e35677cd3f0cc8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:51.955578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62c0afc301a44f884e35677cd3f0cc8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:51.956221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62c0afc301a44f884e35677cd3f0cc8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:51.956827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62c0afc301a44f884e35677cd3f0cc8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:51.999001 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1389/2762] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:51 2022] PUT /identity/v3/projects/277d7b32a4f448c8bf91e0410b0572ac/users/c030ef0e10fa41ee89824602f2207d09/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:52.003008 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:52.004681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.061295 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-d155d313-9e60-4ffc-98ac-72af97a90668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62c0afc301a44f884e35677cd3f0cc8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:52.072113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeaa51-b2bc-4c6f-8465-d14392ff9124 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:52.075585 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:52.076428 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.076786 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.077133 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.077946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:52.079263 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1374/2763] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:51 2022] DELETE /identity/v3/users/d62c0afc301a44f884e35677cd3f0cc8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:52.079716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:52.083597 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.083887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.084163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.095747 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1390/2764] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:52.099856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:52.111757 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157b79-2cc0-4878-95b3-9db3d4d1c80e admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:52.126059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:52.126059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.170815 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:52.171711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.171988 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.172256 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] PATH_INFO: `/v3/projects/277d7b32a4f448c8bf91e0410b0572ac/users/c030ef0e10fa41ee89824602f2207d09/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.174317 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=277d7b32a4f448c8bf91e0410b0572ac, user_id=c030ef0e10fa41ee89824602f2207d09, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:52.176943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4ba7-30fa-4626-994e-ffcc2190003b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:52.187038 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1391/2765] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:52 2022] PUT /identity/v3/projects/277d7b32a4f448c8bf91e0410b0572ac/users/c030ef0e10fa41ee89824602f2207d09/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:52.188894 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1375/2766] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:52.197089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.197492 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.197779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.198842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:52.200232 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.224768 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] MFA Rules not processed for user `c030ef0e10fa41ee89824602f2207d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:52.225966 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.257975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313ec5-7523-467d-9d29-8b02f21ac3a0 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:52.294724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1392/2767] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:52.305388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:52.306953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.307694 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:52.308357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.308637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.308923 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.371117 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794f7d-8901-4153-8029-1c3a3beff302 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:52.380100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:52.382034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:52.382463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:52.382708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.382991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.383265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.393877 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:52.395327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:52.397950 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1376/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:52.408047 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1393/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:52.574484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:52.581927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.588488 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478d9e9-62bb-4898-ad0b-0d305db34868 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:52.592745 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:52.593439 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:52.593738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:52.593993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:52.595784 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:52.657245 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:52.658732 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4943-86f9-4c1f-8620-bc48a54d87e5 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:52.682238 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1377/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:53.102268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.103946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:53.124245 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f815b4-6fc3-43d7-b552-74e327a7b644 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.134793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.135726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.136080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.136419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] PATH_INFO: `/v3/projects/6b28888a4f2c45c5b1b2b4ecdf69c978` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.138357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b28888a4f2c45c5b1b2b4ecdf69c978)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.140496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.254201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b28888a4f2c45c5b1b2b4ecdf69c978', 'request_id': 'req-92b0bae4-f4a3-4212-beed-5fc324159d05'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:53.259590 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b28888a4f2c45c5b1b2b4ecdf69c978', 'request_id': 'req-92b0bae4-f4a3-4212-beed-5fc324159d05'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:53.340504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b28888a4f2c45c5b1b2b4ecdf69c978', 'request_id': 'req-92b0bae4-f4a3-4212-beed-5fc324159d05'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:53.352691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] The token cache is being invalidate because project 6b28888a4f2c45c5b1b2b4ecdf69c978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:53.352976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:53.353610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-92b0bae4-f4a3-4212-beed-5fc324159d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:53.355206 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1394/2771] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:53 2022] DELETE /identity/v3/projects/6b28888a4f2c45c5b1b2b4ecdf69c978 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:53.360265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.360557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.360834 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.378409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:53.379654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:53.439572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1378/2772] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:53.447406 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.447693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.447965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.467062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:53.468506 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:53.476507 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1395/2773] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:53.481056 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.491374 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1e70d-101f-4b19-9f9e-0cda8892ce73 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.496101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.497248 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.497525 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.497827 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.498587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:31:53.498889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.500487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.512130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1379/2774] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:31:53.517656 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.527115 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf9e1-7239-40d8-b93c-dc613466571c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.531752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.532393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.532669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.532941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.533655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.535582 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.616236 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1396/2775] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:31:53 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:31:53.620705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.632055 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d58e-ef46-49fa-9721-af3fc5ac450c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.686487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.687093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.687357 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.687622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.688307 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.690230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.762200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1380/2776] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:31:53 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:31:53.766825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.776825 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbf3d-6c1d-4495-99d7-c9da3ead3818 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.781432 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.782118 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.782402 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.782672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.783392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.784977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.794979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1397/2777] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:31:53.798713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.808656 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56622ff-383c-46fd-9ea9-28ae27aed3f3 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.813865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.814546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.814828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.815101 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.815816 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.817434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4c2e5-4806-44d3-a2e0-c876770c978f admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.827782 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1381/2778] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:31:53.831726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:53.841520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675746c-8d62-4a04-8a8e-1b2054b52aaf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:53.846114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:53.846976 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.847253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.847526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] PATH_INFO: `/v3/projects/275d3e17ee2745089e0cd749c1f4147f/users/9297e6ca5a7544979d401f3c87bcc3c5/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.861454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275d3e17ee2745089e0cd749c1f4147f, user_id=9297e6ca5a7544979d401f3c87bcc3c5, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:53.864123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:53.956847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1398/2779] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:31:53 2022] PUT /identity/v3/projects/275d3e17ee2745089e0cd749c1f4147f/users/9297e6ca5a7544979d401f3c87bcc3c5/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:53.968017 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:53.971012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:53.971012 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:53.994955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] MFA Rules not processed for user `9297e6ca5a7544979d401f3c87bcc3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:53.996219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:54.058536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1382/2780] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:54.070273 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:54.071956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:54.127704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394d76-1957-4cfb-86d0-82897946cf64 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:54.131378 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:54.132017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:54.132297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:54.132569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:54.140726 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:54.142184 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0795df5-4d1e-4044-9e2b-5aa9002a4dd4 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:54.150721 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1399/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:57.770511 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:57.771904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:57.833969 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe408-05b7-4cc1-a085-9c31a354a209 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:57.838457 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:57.839314 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:57.839594 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:57.839866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] PATH_INFO: `/v3/users/1ef4990c336444b6bd932baa29295bd6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:57.841711 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef4990c336444b6bd932baa29295bd6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:57.843766 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:58.050509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef4990c336444b6bd932baa29295bd6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.057139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef4990c336444b6bd932baa29295bd6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.057795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef4990c336444b6bd932baa29295bd6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.058410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef4990c336444b6bd932baa29295bd6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.129065 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef4990c336444b6bd932baa29295bd6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.147211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1383/2782] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:57 2022] DELETE /identity/v3/users/1ef4990c336444b6bd932baa29295bd6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:58.151859 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:58.152307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:58.152431 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:58.172204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:58.173397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:58.236917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1400/2783] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:31:58.246880 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:58.248270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:58.304917 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ecc7-30de-4058-b558-dd29f48a58e6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:58.308397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:58.309025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:58.309322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:58.309593 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:58.318343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:58.319767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:58.328964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1384/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:31:58.599055 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:58.600423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:58.612546 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a97c-cb1b-41f9-a76d-6169a9af86ee None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:58.620063 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:58.621143 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:58.621423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:58.621690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] PATH_INFO: `/v3/users/9297e6ca5a7544979d401f3c87bcc3c5` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:58.624260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9297e6ca5a7544979d401f3c87bcc3c5)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:58.626194 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:58.754222 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:58.755734 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:58.791099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908811-7e3d-46a6-a31e-969a68fd204b service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:58.791099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:58.791099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:58.791099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:58.791958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] PATH_INFO: `/v3/projects/271395157d134a7f916d12ba8baea859` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:58.791958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] RBAC: Authorizing `identity:delete_project(project_id=271395157d134a7f916d12ba8baea859)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:58.791958 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:58.840163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9297e6ca5a7544979d401f3c87bcc3c5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.846879 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9297e6ca5a7544979d401f3c87bcc3c5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.847537 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9297e6ca5a7544979d401f3c87bcc3c5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.934744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271395157d134a7f916d12ba8baea859', 'request_id': 'req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.939943 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271395157d134a7f916d12ba8baea859', 'request_id': 'req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.947039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9297e6ca5a7544979d401f3c87bcc3c5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.947809 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-29f58017-e5d1-4456-a46a-8debc70a669b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9297e6ca5a7544979d401f3c87bcc3c5'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:58.966887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1401/2785] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:58 2022] DELETE /identity/v3/users/9297e6ca5a7544979d401f3c87bcc3c5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:58.971465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:58.971767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:58.972417 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:58.991509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:58.992748 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.043640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271395157d134a7f916d12ba8baea859', 'request_id': 'req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.056613 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] The token cache is being invalidate because project 271395157d134a7f916d12ba8baea859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:59.056900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.057396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1402/2786] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:59.061220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.061220 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1385/2787] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:58 2022] DELETE /identity/v3/projects/271395157d134a7f916d12ba8baea859 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:59.068230 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:59.068411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:59.069581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.069679 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.132571 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15894cd7-db7b-40b4-800a-cd29c12d4846 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:59.136610 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:59.138070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.138357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.138720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.140421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.149803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181a8e8-5753-4ea1-82fe-1c0e4dbededc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:59.152532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:59.154177 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:59.155009 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:59.155881 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.156161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.156435 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] PATH_INFO: `/v3/users/c030ef0e10fa41ee89824602f2207d09` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.157637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c030ef0e10fa41ee89824602f2207d09)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:59.159761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:59.165638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1403/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:31:59.342296 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c030ef0e10fa41ee89824602f2207d09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.348785 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c030ef0e10fa41ee89824602f2207d09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.349442 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c030ef0e10fa41ee89824602f2207d09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.350091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c030ef0e10fa41ee89824602f2207d09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.415038 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c030ef0e10fa41ee89824602f2207d09'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.432914 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1386/2789] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:31:59 2022] DELETE /identity/v3/users/c030ef0e10fa41ee89824602f2207d09 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:31:59.593461 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:59.594943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.607168 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb136a-cde6-497e-88b5-5768adfb8021 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:59.669271 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:59.670268 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.670471 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.670740 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] PATH_INFO: `/v3/projects/275d3e17ee2745089e0cd749c1f4147f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.671915 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=275d3e17ee2745089e0cd749c1f4147f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:59.673826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:59.820253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275d3e17ee2745089e0cd749c1f4147f', 'request_id': 'req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.826394 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275d3e17ee2745089e0cd749c1f4147f', 'request_id': 'req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.868081 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:31:59.869509 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.885524 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41094a9e-4b44-49bc-af2c-294f1c9698eb admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:31:59.917589 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275d3e17ee2745089e0cd749c1f4147f', 'request_id': 'req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.931437 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] The token cache is being invalidate because project 275d3e17ee2745089e0cd749c1f4147f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:31:59.931725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.932419 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-be91f4a5-4aca-4fc8-9b0f-f149704f4aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:31:59.934084 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1404/2790] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:59 2022] DELETE /identity/v3/projects/275d3e17ee2745089e0cd749c1f4147f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:31:59.939311 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29d78-7397-4359-b061-d736f8ec0ccd None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.939592 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29d78-7397-4359-b061-d736f8ec0ccd None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.939861 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29d78-7397-4359-b061-d736f8ec0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.943899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:31:59.945075 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.945360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.945636 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] PATH_INFO: `/v3/projects/277d7b32a4f448c8bf91e0410b0572ac` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.946863 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277d7b32a4f448c8bf91e0410b0572ac)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:31:59.948765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:31:59.958651 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-72a29d78-7397-4359-b061-d736f8ec0ccd None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:59.960004 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-72a29d78-7397-4359-b061-d736f8ec0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:31:59.968927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1405/2791] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:31:59.976566 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:31:59.976789 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:31:59.977068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:31:59.994785 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:31:59.995941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.003945 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1406/2792] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:00.007909 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.016999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d293-9fb3-44f0-8d64-8c0991cdc272 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.021668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.022357 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.022635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.022905 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.023608 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:00.023937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.025541 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.037189 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1407/2793] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:32:00.041091 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.050662 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db219668-bfd6-4a69-b4b5-99fe52e67360 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.055124 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.055744 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.056025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.056294 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.056948 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.058833 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.077653 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277d7b32a4f448c8bf91e0410b0572ac', 'request_id': 'req-1c682125-0fd8-44bc-9fd5-be8e2c054324'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.082886 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277d7b32a4f448c8bf91e0410b0572ac', 'request_id': 'req-1c682125-0fd8-44bc-9fd5-be8e2c054324'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.131355 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1408/2794] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:00.135255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.140930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277d7b32a4f448c8bf91e0410b0572ac', 'request_id': 'req-1c682125-0fd8-44bc-9fd5-be8e2c054324'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.152512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] The token cache is being invalidate because project 277d7b32a4f448c8bf91e0410b0572ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:00.152796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.153451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-1c682125-0fd8-44bc-9fd5-be8e2c054324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.155054 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1387/2795] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:31:59 2022] DELETE /identity/v3/projects/277d7b32a4f448c8bf91e0410b0572ac => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:00.159616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fff26-5669-4063-9ebb-38408d5241f3 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.159900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fff26-5669-4063-9ebb-38408d5241f3 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.160172 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fff26-5669-4063-9ebb-38408d5241f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.179419 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-436fff26-5669-4063-9ebb-38408d5241f3 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:00.180620 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-436fff26-5669-4063-9ebb-38408d5241f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.195284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208925e-3be2-44d6-ac99-4b71b8b50056 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.200386 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.201029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.201307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.201576 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.202289 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.204187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.238091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1388/2796] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:00.245899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.246211 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.246480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.264569 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:00.265763 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.273551 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1389/2797] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:00.277255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.285748 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0c12-f662-446c-8682-0ec96ab113ef None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.289281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1409/2798] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:00.290482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.291111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.291387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.291657 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.292533 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:00.292841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.293272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.294522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.295338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.306073 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1390/2799] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:32:00.307326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388177-2a96-479c-92ea-c5ea9b40fcc9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.310612 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.312707 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.313389 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.313669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.315463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.315463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.316410 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.319992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ca4a-c162-47e7-93a2-2a6b02bba02d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.324826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.326182 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.326462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.326733 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.329724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1410/2800] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:32:00.329840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.329840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.330708 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.339967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062769a-d556-4414-8c3d-4e6f631ce4cf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.344572 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.345200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.345481 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.345750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.346490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.348067 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.359223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1411/2801] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:32:00.363131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.373066 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904846-aba5-4c70-b690-666847bff9e5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.377556 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.378404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.378686 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.378959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] PATH_INFO: `/v3/projects/e22021bb170148799869457106275b7f/users/29192d52d59e4afeb5ab4f2bbac63c6f/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.397477 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22021bb170148799869457106275b7f, user_id=29192d52d59e4afeb5ab4f2bbac63c6f, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.400760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.444700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1391/2802] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:00.453335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.453335 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.477650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1412/2803] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:00 2022] PUT /identity/v3/projects/e22021bb170148799869457106275b7f/users/29192d52d59e4afeb5ab4f2bbac63c6f/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:00.478496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.510354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e443795-8097-4ac7-82f8-ff12a6196d9d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.538136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9c28-a252-4036-9741-3fd8452629c9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.543024 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.543756 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.544041 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.544321 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.545017 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.547010 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c1179-0051-42fa-869b-36d89ddd9a0e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.564519 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.565388 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.572137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.572137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] PATH_INFO: `/v3/users/e8f152c666904ca8996b903149e35322` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.572137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f152c666904ca8996b903149e35322)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.572137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.629252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1413/2804] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:00.629252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.629252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.629252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.663284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] MFA Rules not processed for user `29192d52d59e4afeb5ab4f2bbac63c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:00.663284 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.718743 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1414/2805] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:00.719713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.730132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19186f3e-5231-42ae-a8f0-eb889ad9abfa None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.735033 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.735680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.735956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.736224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.736970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.738641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.748465 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1415/2806] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:00.749286 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.751034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.782440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f152c666904ca8996b903149e35322'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.789135 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f152c666904ca8996b903149e35322'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.789798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f152c666904ca8996b903149e35322'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.790475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f152c666904ca8996b903149e35322'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.805138 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a653a-4c70-4683-b9d8-0cfb0e02871b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.808766 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.809423 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.809698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.809968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.811697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.821849 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.823292 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.832278 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1416/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:00.833123 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.834426 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.847221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2655-e2fc-4819-b49d-bac133ebf110 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.851685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.852314 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.852588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.852857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.853565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.855131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.860412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-fd13aebf-a301-4eb3-a2fa-4fd09f1a3240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f152c666904ca8996b903149e35322'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:00.865078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1417/2808] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:00.869414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.879750 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f297f66-7b9e-45cd-a060-b5183b5121c3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:00.879893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1392/2809] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:00 2022] DELETE /identity/v3/users/e8f152c666904ca8996b903149e35322 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:00.884558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.884893 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.885364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.904216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:00.905462 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:00.941839 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:00.942711 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:00.942977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:00.943246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] PATH_INFO: `/v3/projects/6fd5d0f6a7ac4ab19c3d50c6a2281d19/users/bb76b28259bf4c048415395abf6839c6/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:00.959421 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd5d0f6a7ac4ab19c3d50c6a2281d19, user_id=bb76b28259bf4c048415395abf6839c6, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:00.962176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7086ea5-21c2-48e1-864a-97d399140684 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:00.968189 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1393/2810] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:00.977963 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:00.979375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.034795 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4d87-5d50-489d-b0ac-5c15ff8f5801 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.038350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.039008 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.039282 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.039552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.049091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.050558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.055132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1418/2811] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:00 2022] PUT /identity/v3/projects/6fd5d0f6a7ac4ab19c3d50c6a2281d19/users/bb76b28259bf4c048415395abf6839c6/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:01.060726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1394/2812] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:32:01.065826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.066297 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.066575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.093056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] MFA Rules not processed for user `bb76b28259bf4c048415395abf6839c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:01.098187 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.162489 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1419/2813] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:01.167216 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.176865 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a742d8-5c42-42d1-b7fa-a4e6f34b175f service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.232354 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.233036 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.233312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.233579 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.234334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.236543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.346192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1395/2814] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:01.347356 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.358237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4abc61-1cab-4bda-a0d5-b261ccb28fbf None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.414274 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.414968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.415246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.415511 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.416232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.418210 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.481270 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.481891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.494703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47a60-80db-473d-a8a7-c0b8e869c28d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.499668 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.500540 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.500822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.501094 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] PATH_INFO: `/v3/projects/6d84dd83e70649c2a39dba2a7f579edf` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.502326 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d84dd83e70649c2a39dba2a7f579edf)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.504236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.511463 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1420/2815] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:01.513199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.525035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e1d1-d736-4ba7-a3ca-326a5dd8585a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.530514 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.531415 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.531762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.532161 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.532913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.534667 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.549068 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1421/2816] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:01.564818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.564818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e859b3-8e4c-41ca-acd4-b7bfbcfc093f admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.564818 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.565594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.565594 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.565946 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] PATH_INFO: `/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1/users/dbf8c07370064689a9a2ed3f97983f8a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.581326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83cf480d4e141b9b6b4b0dd218daac1, user_id=dbf8c07370064689a9a2ed3f97983f8a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.584020 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.677487 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1422/2817] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:01 2022] PUT /identity/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1/users/dbf8c07370064689a9a2ed3f97983f8a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:01.681731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.685897 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d84dd83e70649c2a39dba2a7f579edf', 'request_id': 'req-c1a41574-6b94-4707-8e13-b6d97b1f9841'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:01.691291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d84dd83e70649c2a39dba2a7f579edf', 'request_id': 'req-c1a41574-6b94-4707-8e13-b6d97b1f9841'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:01.748099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92874-513a-44fc-96df-cb45e515bd01 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.774687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d84dd83e70649c2a39dba2a7f579edf', 'request_id': 'req-c1a41574-6b94-4707-8e13-b6d97b1f9841'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:01.786587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] The token cache is being invalidate because project 6d84dd83e70649c2a39dba2a7f579edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:01.786869 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:01.787508 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-c1a41574-6b94-4707-8e13-b6d97b1f9841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:01.789068 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1396/2818] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:01 2022] DELETE /identity/v3/projects/6d84dd83e70649c2a39dba2a7f579edf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:01.793822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d00-941a-4343-bfbb-8f3200b1f08c None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.794123 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d00-941a-4343-bfbb-8f3200b1f08c None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.794397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d00-941a-4343-bfbb-8f3200b1f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.805685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.806392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.806668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.806949 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.807682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.809817 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.811856 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-e99c8d00-941a-4343-bfbb-8f3200b1f08c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:01.813037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e99c8d00-941a-4343-bfbb-8f3200b1f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.819680 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1423/2819] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:01.820765 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1397/2820] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:01.823908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.826442 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.828831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.829113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.829389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.838874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b9cca-f281-46f7-826c-485afd50d7a6 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.843617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.844488 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.844760 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.845025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] PATH_INFO: `/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1/users/dbf8c07370064689a9a2ed3f97983f8a/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.847019 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83cf480d4e141b9b6b4b0dd218daac1, user_id=dbf8c07370064689a9a2ed3f97983f8a, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.849184 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:01.849632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e584f9-9703-4593-931b-ae2cd695c768 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.850387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.858343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1398/2821] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:01.862191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.862889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1424/2822] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:01 2022] PUT /identity/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1/users/dbf8c07370064689a9a2ed3f97983f8a/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:01.871195 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4808-69ae-4b0d-9155-870a2bb8c19f None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.880996 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.881279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.881547 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.907486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] MFA Rules not processed for user `dbf8c07370064689a9a2ed3f97983f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:01.908669 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:01.926895 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.927549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.927826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.928099 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.928840 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:01.929152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.930800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.942995 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1399/2823] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 14:32:01.947192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.957204 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662ffbe-038c-40b9-8c28-5c49c3728af0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:01.961800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:01.962440 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:01.962715 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:01.962984 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:01.963654 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:01.965552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:01.976307 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1425/2824] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 14:32:01.990881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:01.992270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:02.047565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4aef-a498-4e87-a7d3-e714a044b277 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.051165 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.051805 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.052088 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.052359 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.061239 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.062710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.072204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1426/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:32:02.079047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1400/2826] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:01 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:02.083089 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.093412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7457692-9682-4509-819c-a837b7f3e9c4 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.151473 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.152134 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.152412 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.152685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.153999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.155930 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.247237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1427/2827] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:02 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:02.248366 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.259163 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8fe19-fbcc-4231-8989-39f7ba66c937 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.265463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.266192 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.266478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.266755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.267483 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.269072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.283546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1401/2828] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:32:02.284688 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.298414 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa951-557c-4ed6-be11-bc5527022ed2 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.302217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.302885 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.303166 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.303438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.304175 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.305770 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c6d7-9df1-49cd-a428-eed2101f2e3d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.316672 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1428/2829] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:02.320522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.330989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fc696-773a-4af9-b413-7a9cb60ef771 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.335646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.336512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.336788 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.337057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] PATH_INFO: `/v3/projects/9b33bfe645d443ffa7941312c09db8af/users/7384fcddf91545959d62687d053ac397/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.353696 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b33bfe645d443ffa7941312c09db8af, user_id=7384fcddf91545959d62687d053ac397, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.354611 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.442896 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1402/2830] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:02 2022] PUT /identity/v3/projects/9b33bfe645d443ffa7941312c09db8af/users/7384fcddf91545959d62687d053ac397/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:02.454497 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.454972 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.455056 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.481215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] MFA Rules not processed for user `7384fcddf91545959d62687d053ac397`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:02.482484 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:02.528264 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.549538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1429/2831] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:02.562199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:02.564215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:02.599530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cb59e-9fad-4c10-842c-584acd2cafd6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.605930 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.606844 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.607121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.607391 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] PATH_INFO: `/v3/users/bb76b28259bf4c048415395abf6839c6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.608898 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb76b28259bf4c048415395abf6839c6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.610848 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.622475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3c35-f54e-4fc9-90b6-6a9ea2dd7f59 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:02.626884 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:02.627338 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.627617 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.627887 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.637257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:02.639275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683132f-b048-4459-b09b-acf92ce176de service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:02.648035 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1430/2832] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:32:02.766174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb76b28259bf4c048415395abf6839c6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:02.773174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb76b28259bf4c048415395abf6839c6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:02.774072 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb76b28259bf4c048415395abf6839c6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:02.774707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb76b28259bf4c048415395abf6839c6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:02.889661 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb76b28259bf4c048415395abf6839c6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:02.907302 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1403/2833] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:02 2022] DELETE /identity/v3/users/bb76b28259bf4c048415395abf6839c6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:02.911854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:02.912150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:02.912425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:02.930096 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:02.931277 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:02.989413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1431/2834] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:03.000283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:03.001812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:03.058367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a729d-3c48-4f6b-ae69-cb5d3da29309 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:03.062546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:03.063193 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:03.063475 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:03.063747 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:03.073034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:03.074495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:03.084007 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1404/2835] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:03.520103 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:03.521800 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:03.540113 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21cc8a-e169-472b-b08d-c1b44e27f405 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:03.546724 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:03.547729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:03.548131 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:03.548486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] PATH_INFO: `/v3/projects/6fd5d0f6a7ac4ab19c3d50c6a2281d19` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:03.549943 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd5d0f6a7ac4ab19c3d50c6a2281d19)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:03.552158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:03.677527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd5d0f6a7ac4ab19c3d50c6a2281d19', 'request_id': 'req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:03.682852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd5d0f6a7ac4ab19c3d50c6a2281d19', 'request_id': 'req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:03.757270 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd5d0f6a7ac4ab19c3d50c6a2281d19', 'request_id': 'req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:03.768970 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] The token cache is being invalidate because project 6fd5d0f6a7ac4ab19c3d50c6a2281d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:03.769255 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:03.769889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:03.771464 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1432/2836] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:03 2022] DELETE /identity/v3/projects/6fd5d0f6a7ac4ab19c3d50c6a2281d19 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:03.775478 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:03.785503 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f820-1ed9-4ef9-841a-03add79b3732 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:03.839595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:03.840459 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:03.841372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:03.841642 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] PATH_INFO: `/v3/users/dbf8c07370064689a9a2ed3f97983f8a` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:03.842857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf8c07370064689a9a2ed3f97983f8a)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:03.844773 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:03.851856 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:03.853253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:03.866615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bf794-91b7-4fe8-8c74-c0f516b1c7ed admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:03.871539 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:03.872443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:03.872709 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:03.872981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] PATH_INFO: `/v3/users/29192d52d59e4afeb5ab4f2bbac63c6f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:03.874287 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29192d52d59e4afeb5ab4f2bbac63c6f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:03.876326 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:04.067655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf8c07370064689a9a2ed3f97983f8a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.074345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf8c07370064689a9a2ed3f97983f8a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.075003 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf8c07370064689a9a2ed3f97983f8a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.075605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf8c07370064689a9a2ed3f97983f8a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.096404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29192d52d59e4afeb5ab4f2bbac63c6f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.105142 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29192d52d59e4afeb5ab4f2bbac63c6f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.105822 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29192d52d59e4afeb5ab4f2bbac63c6f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.174927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-a1853a23-1565-4a58-94c4-8d3f43480fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf8c07370064689a9a2ed3f97983f8a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.192522 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1405/2837] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:03 2022] DELETE /identity/v3/users/dbf8c07370064689a9a2ed3f97983f8a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:04.254508 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29192d52d59e4afeb5ab4f2bbac63c6f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.255132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29192d52d59e4afeb5ab4f2bbac63c6f'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.272638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1433/2838] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:03 2022] DELETE /identity/v3/users/29192d52d59e4afeb5ab4f2bbac63c6f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:04.277191 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:04.277482 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:04.277751 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:04.295585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:04.296761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:04.352931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1406/2839] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:04.363258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:04.364659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:04.425354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002334b8-1d69-4e59-93e6-ef505a72504c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:04.429036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:04.429691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:04.429973 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:04.430280 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:04.440054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:04.441480 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace19b60-3cb1-43ed-86ba-29e25d0fbac4 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:04.451051 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1434/2840] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:04.641122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:04.642552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:04.654954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718db3-b35c-4f59-b5d3-f32feaf1e092 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:04.661484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:04.662841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:04.662938 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:04.663257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] PATH_INFO: `/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:04.664543 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83cf480d4e141b9b6b4b0dd218daac1)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:04.666534 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:04.802991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83cf480d4e141b9b6b4b0dd218daac1', 'request_id': 'req-5bf1902b-34c7-44f5-a199-00146122b5b3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.809052 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83cf480d4e141b9b6b4b0dd218daac1', 'request_id': 'req-5bf1902b-34c7-44f5-a199-00146122b5b3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.895476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83cf480d4e141b9b6b4b0dd218daac1', 'request_id': 'req-5bf1902b-34c7-44f5-a199-00146122b5b3'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.908323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] The token cache is being invalidate because project c83cf480d4e141b9b6b4b0dd218daac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:04.908687 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.909662 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5bf1902b-34c7-44f5-a199-00146122b5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:04.916922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:04.917361 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:04.917520 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:04.918258 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1407/2841] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:04 2022] DELETE /identity/v3/projects/c83cf480d4e141b9b6b4b0dd218daac1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:04.937416 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:04.938660 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:05.001977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1435/2842] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:05.059361 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.059650 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.059928 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.077860 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:05.079087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:05.084908 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.086555 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:05.087776 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1408/2843] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:05.092030 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.103911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf721fa0-c685-47c2-a2c9-2e01c6384fd7 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.107227 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.107952 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.108298 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.108578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] PATH_INFO: `/v3/domains` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.109306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86653) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:05.109616 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.111338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.115230 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180439cd-ac27-43c8-94a4-38906be99db1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.120671 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.121754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.122229 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.122581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] PATH_INFO: `/v3/projects/e22021bb170148799869457106275b7f` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.124223 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22021bb170148799869457106275b7f)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.126780 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.127920 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1409/2844] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:32:05.131866 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.142955 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a463f1-4d8f-4d60-be1d-790886a07757 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.147935 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.148762 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.149046 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.149327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.150067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.152084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.254545 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22021bb170148799869457106275b7f', 'request_id': 'req-39b16d90-4206-4038-a468-23690243a371'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:05.259727 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22021bb170148799869457106275b7f', 'request_id': 'req-39b16d90-4206-4038-a468-23690243a371'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:05.324415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1410/2845] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:05.328859 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.340346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22021bb170148799869457106275b7f', 'request_id': 'req-39b16d90-4206-4038-a468-23690243a371'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:05.352683 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] The token cache is being invalidate because project e22021bb170148799869457106275b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:05.352971 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:05.353626 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:05.355215 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1436/2846] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:05 2022] DELETE /identity/v3/projects/e22021bb170148799869457106275b7f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:05.396664 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7f6a4-70da-4db3-9a19-c68b4bf56d80 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.401490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.402250 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.402536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.402812 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.404260 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.406283 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.495463 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1411/2847] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:05.500443 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.501984 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:05.585110 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16d90-4206-4038-a468-23690243a371 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.590031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.591346 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.592618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.592618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.592618 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.594279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.608614 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1437/2848] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:05.609828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.620114 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc417a-684d-4231-91c0-2d34678d6820 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.624640 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.625291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.625565 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.625831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.626623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.628235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e533f-6777-42ee-b9a1-9654c4af8a47 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.637922 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1412/2849] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:05.641963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.651761 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee8af1-a474-44ca-9841-93c286021a3b admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.656764 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.657627 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.657902 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.658204 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] PATH_INFO: `/v3/projects/38ddd3b4c62e41c195815c1f6a120fd9/users/20088c14dd8b43b890738349bafaaee7/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.674979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ddd3b4c62e41c195815c1f6a120fd9, user_id=20088c14dd8b43b890738349bafaaee7, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.677645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.751850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1438/2850] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:05 2022] PUT /identity/v3/projects/38ddd3b4c62e41c195815c1f6a120fd9/users/20088c14dd8b43b890738349bafaaee7/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:05.765174 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.765461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.765735 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.791851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] MFA Rules not processed for user `20088c14dd8b43b890738349bafaaee7`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:05.793042 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:05.853961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1413/2851] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:05.859153 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:05.919411 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a881e-709f-4a66-a40f-c7f2e897e01d admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:05.924046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:05.924698 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:05.924982 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:05.925260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:05.925958 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:05.927880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:05.992816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1439/2852] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:05.996845 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.007398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45248-2459-4f28-b9f1-6fd4d3672e2a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.080343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.081415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.081415 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.081677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.082277 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.084203 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.180705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1414/2853] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:05 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:06.184919 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.195358 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba6a2-0ad3-409b-9240-51bdaa14e7f5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.200644 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.201716 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.202178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.202580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.203425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.205009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.216219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1440/2854] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:06.220236 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.230088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0d3c-e821-40f7-846b-1edc88ef38c0 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.234578 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.235219 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.235495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.235761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.236476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.238053 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55663ff-60a0-456f-9be9-e018ec324aca admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.248389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1415/2855] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:32:06.252217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.261615 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9beda56-8fc4-491d-a62f-5a6b598aff69 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.266779 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.267632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.267907 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.268176 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] PATH_INFO: `/v3/projects/56f8a6969759435384f47c5f40a04476/users/3fe24042fa0f4c1fa8ad9dafb2d880cb/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.281999 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f8a6969759435384f47c5f40a04476, user_id=3fe24042fa0f4c1fa8ad9dafb2d880cb, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.284755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.371364 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1441/2856] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:06 2022] PUT /identity/v3/projects/56f8a6969759435384f47c5f40a04476/users/3fe24042fa0f4c1fa8ad9dafb2d880cb/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:06.389596 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.389904 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.390206 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.418901 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] MFA Rules not processed for user `3fe24042fa0f4c1fa8ad9dafb2d880cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:06.420104 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:06.481580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1416/2857] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:06.485927 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.549890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d205-e67c-4980-8212-a16974c823f3 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.554645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.555296 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.555573 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.555843 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.556668 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.558593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.651265 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1442/2858] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:06 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:06.655090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.665708 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b10a9c-998a-4c67-852d-a20178543c0e None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.723794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.724480 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.724756 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.725049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.725761 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.727738 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.814106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1417/2859] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:06 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:06.818006 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.828609 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedbd3a-7cd1-4a5b-9772-b68d19620fac admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.833178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.833823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.834135 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.834409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.835125 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.836742 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.854774 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1443/2860] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:06.856102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:06.867327 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97d4d-8e73-4a73-96b5-e9b984497bb7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:06.872576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:06.873510 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:06.873887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:06.874087 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] PATH_INFO: `/v3/projects/7762308809bd479bbd0c1a72552920fb/users/98e7f49976da4dad8eac465197f338e2/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:06.889722 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7762308809bd479bbd0c1a72552920fb, user_id=98e7f49976da4dad8eac465197f338e2, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:06.892740 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:06.998343 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1418/2861] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:06 2022] PUT /identity/v3/projects/7762308809bd479bbd0c1a72552920fb/users/98e7f49976da4dad8eac465197f338e2/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:07.002368 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:07.012527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e2571-a65b-411c-9b81-8d7a21242aa1 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:07.069967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:07.070722 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:07.071012 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:07.071279 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:07.072000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:07.074231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef841b5-7eed-4866-9e8a-0631832be875 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:07.084198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1444/2862] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:07.088465 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:07.099717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2f58-7e1e-4167-84eb-92bbb7188bbc admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:07.104874 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:07.105760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:07.106064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:07.106365 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] PATH_INFO: `/v3/projects/7762308809bd479bbd0c1a72552920fb/users/98e7f49976da4dad8eac465197f338e2/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:07.110259 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7762308809bd479bbd0c1a72552920fb, user_id=98e7f49976da4dad8eac465197f338e2, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:07.111609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:07.122047 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1419/2863] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:07 2022] PUT /identity/v3/projects/7762308809bd479bbd0c1a72552920fb/users/98e7f49976da4dad8eac465197f338e2/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:07.133354 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619163-7b59-454d-9ca1-27582970407e None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:07.133682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619163-7b59-454d-9ca1-27582970407e None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:07.133964 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619163-7b59-454d-9ca1-27582970407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:07.159723 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-dd619163-7b59-454d-9ca1-27582970407e None None] MFA Rules not processed for user `98e7f49976da4dad8eac465197f338e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:07.160928 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dd619163-7b59-454d-9ca1-27582970407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:07.226376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1445/2864] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:07.238637 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:07.240312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:07.296294 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0bfd2-4b14-4f3f-81be-729583612a61 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:07.299918 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:07.300726 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:07.301122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:07.301341 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:07.355717 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:07.357225 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:07.366349 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1420/2865] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:09.227109 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd619163-7b59-454d-9ca1-27582970407e None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:09.228526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-dd619163-7b59-454d-9ca1-27582970407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:09.241070 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd619163-7b59-454d-9ca1-27582970407e None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:09.244605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:09.245248 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:09.245526 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:09.245797 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:09.301906 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:09.303438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:09.312219 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1446/2866] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:10.579512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:10.588025 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1959-430f-4ea6-ac03-a5d56972f7a2 service cinder] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:10.591621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:10.592252 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:10.592526 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:10.592798 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:10.601546 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:10.602991 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41b50-27e0-4f28-a167-4cf9a0dece23 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:10.612753 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1421/2867] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:17.273155 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:17.333290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a3e9-193e-483e-a45b-93e5141be3a4 service cinder] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:17.337934 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:17.338854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:17.339129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:17.339395 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] PATH_INFO: `/v3/users/20088c14dd8b43b890738349bafaaee7` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:17.340630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20088c14dd8b43b890738349bafaaee7)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:17.343141 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:17.513998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20088c14dd8b43b890738349bafaaee7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:17.520738 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20088c14dd8b43b890738349bafaaee7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:17.521404 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20088c14dd8b43b890738349bafaaee7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:17.592281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20088c14dd8b43b890738349bafaaee7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:17.592894 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20088c14dd8b43b890738349bafaaee7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:17.610641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1447/2868] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:17 2022] DELETE /identity/v3/users/20088c14dd8b43b890738349bafaaee7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:17.615091 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:17.615560 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:17.615645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:17.641947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:17.643167 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:17.702730 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1422/2869] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:17.712755 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:17.714190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:17.771151 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8ae9-6817-480b-af14-c2f3d7d3d601 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:17.774917 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:17.775558 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:17.775836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:17.776108 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:17.785398 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:17.786926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:17.796803 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1448/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:18.147372 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:18.148889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:18.161169 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90ef0-182c-4775-bc93-360dc243fb46 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:18.165954 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:18.166842 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:18.167122 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:18.167446 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] PATH_INFO: `/v3/projects/38ddd3b4c62e41c195815c1f6a120fd9` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:18.168666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ddd3b4c62e41c195815c1f6a120fd9)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:18.170615 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:18.265862 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ddd3b4c62e41c195815c1f6a120fd9', 'request_id': 'req-ae2f3d69-e5b2-419a-a09c-478d29b9525d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.271106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ddd3b4c62e41c195815c1f6a120fd9', 'request_id': 'req-ae2f3d69-e5b2-419a-a09c-478d29b9525d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.328325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ddd3b4c62e41c195815c1f6a120fd9', 'request_id': 'req-ae2f3d69-e5b2-419a-a09c-478d29b9525d'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.339285 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] The token cache is being invalidate because project 38ddd3b4c62e41c195815c1f6a120fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:18.339567 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.340186 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.342306 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1423/2871] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:18 2022] DELETE /identity/v3/projects/38ddd3b4c62e41c195815c1f6a120fd9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:18.346333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:18.355675 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974187f-e167-414b-8115-1ad51a1a2278 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:18.411691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:18.412475 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:18.412751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:18.413046 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] PATH_INFO: `/v3/users/3fe24042fa0f4c1fa8ad9dafb2d880cb` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:18.414238 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe24042fa0f4c1fa8ad9dafb2d880cb)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:18.416129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:18.581376 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe24042fa0f4c1fa8ad9dafb2d880cb'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.588145 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe24042fa0f4c1fa8ad9dafb2d880cb'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.588788 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe24042fa0f4c1fa8ad9dafb2d880cb'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.631494 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe24042fa0f4c1fa8ad9dafb2d880cb'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.632114 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe24042fa0f4c1fa8ad9dafb2d880cb'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:18.649263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1449/2872] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:18 2022] DELETE /identity/v3/users/3fe24042fa0f4c1fa8ad9dafb2d880cb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:19.010628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:19.012093 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:19.026591 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f3d69-e5b2-419a-a09c-478d29b9525d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:19.085709 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:19.086609 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:19.086892 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:19.087168 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] PATH_INFO: `/v3/projects/56f8a6969759435384f47c5f40a04476` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:19.088342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f8a6969759435384f47c5f40a04476)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:19.090274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:19.207794 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f8a6969759435384f47c5f40a04476', 'request_id': 'req-0e5d1ba2-443c-4234-a362-bc778f7f128a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.212861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f8a6969759435384f47c5f40a04476', 'request_id': 'req-0e5d1ba2-443c-4234-a362-bc778f7f128a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.271443 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f8a6969759435384f47c5f40a04476', 'request_id': 'req-0e5d1ba2-443c-4234-a362-bc778f7f128a'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.282841 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] The token cache is being invalidate because project 56f8a6969759435384f47c5f40a04476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:19.283121 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.283771 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.285293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1424/2873] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:19 2022] DELETE /identity/v3/projects/56f8a6969759435384f47c5f40a04476 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:19.289379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:19.290852 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:19.303963 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6b90-ba52-4a29-ad78-f0fd991ce4cf admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:19.358126 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:19.358990 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:19.359263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:19.359532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] PATH_INFO: `/v3/users/98e7f49976da4dad8eac465197f338e2` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:19.360697 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e7f49976da4dad8eac465197f338e2)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:19.362725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:19.552967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e7f49976da4dad8eac465197f338e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.559542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e7f49976da4dad8eac465197f338e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.560201 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e7f49976da4dad8eac465197f338e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.625820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e7f49976da4dad8eac465197f338e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.626466 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-c6d0af7f-7a4b-40d1-9df6-4733baab633f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e7f49976da4dad8eac465197f338e2'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:19.643540 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1450/2874] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:19 2022] DELETE /identity/v3/users/98e7f49976da4dad8eac465197f338e2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:20.081652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.081652 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:20.110889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1ba2-443c-4234-a362-bc778f7f128a admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.167876 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.168864 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.169141 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.169412 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] PATH_INFO: `/v3/projects/7762308809bd479bbd0c1a72552920fb` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.170621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7762308809bd479bbd0c1a72552920fb)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.173063 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.283496 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7762308809bd479bbd0c1a72552920fb', 'request_id': 'req-ee4b9d87-48ed-408c-93e2-4238776a6d83'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:20.288829 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7762308809bd479bbd0c1a72552920fb', 'request_id': 'req-ee4b9d87-48ed-408c-93e2-4238776a6d83'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:20.374342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7762308809bd479bbd0c1a72552920fb', 'request_id': 'req-ee4b9d87-48ed-408c-93e2-4238776a6d83'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:20.385921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] The token cache is being invalidate because project 7762308809bd479bbd0c1a72552920fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:20.387538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:20.387538 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-ee4b9d87-48ed-408c-93e2-4238776a6d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:20.389793 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1425/2875] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:20 2022] DELETE /identity/v3/projects/7762308809bd479bbd0c1a72552920fb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:20.394645 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.395090 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.395232 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.413085 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:20.414300 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:20.474693 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1451/2876] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:20.484688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.485213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.485736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.505468 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:20.506692 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:20.514427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1426/2877] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:20.518605 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.528129 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a86b7-6407-453b-9f3f-e3f665733126 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.533198 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.538212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.549224 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1452/2878] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:32:20.553213 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.562209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a684419-fb56-4355-9078-097ae88fad14 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.567558 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.568200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.568476 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.568742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.569427 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.571342 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.668247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1427/2879] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:20 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:20.672782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.682781 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5941-8fe0-44b2-a245-01a274749d86 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.736811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.737504 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.737782 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.738082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.738762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.740691 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.815243 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1453/2880] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:20 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:20.819226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.829873 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659fa0-4905-4e36-894e-c36a90eb75ce admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.835159 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.835931 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.836137 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.836471 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.837190 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.838810 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.849910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1428/2881] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 14:32:20.854132 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.863979 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca238-941c-4e4b-9b30-5c4f93eb41e9 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.869237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.869913 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.870227 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.870501 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.871237 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.872850 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80f194-1e4e-4cb3-bb44-c57860fedf55 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.882754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1454/2882] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:20.886677 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:20.897037 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261853ad-b6b5-4c00-8fbb-7f5e3bdc3e23 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:20.901602 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:20.902495 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:20.902809 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:20.903084 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] PATH_INFO: `/v3/projects/fba6d7dff76c40ddaeb787b73e91825f/users/6cc656039e5945c18f0661ad1b33dcc7/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:20.917714 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba6d7dff76c40ddaeb787b73e91825f, user_id=6cc656039e5945c18f0661ad1b33dcc7, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:20.920389 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:20.992127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1429/2883] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:20 2022] PUT /identity/v3/projects/fba6d7dff76c40ddaeb787b73e91825f/users/6cc656039e5945c18f0661ad1b33dcc7/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:32:21.003965 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:21.004252 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:21.004527 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:21.032157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] MFA Rules not processed for user `6cc656039e5945c18f0661ad1b33dcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:21.033385 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:21.096968 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1455/2884] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:21.110515 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:21.113061 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:21.180322 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05fec7-8bdb-487f-bfd2-14d5e7db3f4d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:21.183900 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:21.184544 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:21.184949 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:21.185249 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:21.195839 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:21.197626 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0cb9-86b8-48c5-9850-9d31c7565722 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:21.208512 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1430/2885] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:21.233870 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:21.300560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6f880-b62b-4087-8619-72b7ab325e0b None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:21.310106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:21.311062 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:21.311339 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:21.311632 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] PATH_INFO: `/v3/users/6cc656039e5945c18f0661ad1b33dcc7` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:21.312981 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc656039e5945c18f0661ad1b33dcc7)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:21.315190 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:21.507916 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc656039e5945c18f0661ad1b33dcc7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:21.514957 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc656039e5945c18f0661ad1b33dcc7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:21.515637 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc656039e5945c18f0661ad1b33dcc7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:21.580384 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc656039e5945c18f0661ad1b33dcc7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:21.581042 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc656039e5945c18f0661ad1b33dcc7'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:21.599158 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1456/2886] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:21 2022] DELETE /identity/v3/users/6cc656039e5945c18f0661ad1b33dcc7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:21.603744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:21.604034 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:21.604312 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:21.621200 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:21.627830 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:21.696491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1431/2887] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:21.707857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:21.709390 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:21.767040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f95c6-2048-4661-8069-a7ce796e812a admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:21.770528 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:21.771163 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:21.771438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:21.771704 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:21.780323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:21.782350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aceada-de4e-44f1-981e-ea714958a993 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:21.791657 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1457/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:22.204978 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.206461 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:22.219139 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04624300-f56d-4953-ab76-9d21c5f985c4 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.223808 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.224681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.224947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.225223 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] PATH_INFO: `/v3/projects/fba6d7dff76c40ddaeb787b73e91825f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.226444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba6d7dff76c40ddaeb787b73e91825f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.228350 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.327645 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba6d7dff76c40ddaeb787b73e91825f', 'request_id': 'req-708df76a-a073-4189-9f5c-84bb129c8396'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:22.333323 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba6d7dff76c40ddaeb787b73e91825f', 'request_id': 'req-708df76a-a073-4189-9f5c-84bb129c8396'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:22.397086 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba6d7dff76c40ddaeb787b73e91825f', 'request_id': 'req-708df76a-a073-4189-9f5c-84bb129c8396'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:22.410800 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] The token cache is being invalidate because project fba6d7dff76c40ddaeb787b73e91825f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:22.411224 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:22.411887 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-708df76a-a073-4189-9f5c-84bb129c8396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:22.417493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1432/2889] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:22 2022] DELETE /identity/v3/projects/fba6d7dff76c40ddaeb787b73e91825f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:22.419290 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.419754 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.420034 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.441448 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:22.442685 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:22.507025 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1458/2890] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:22.514826 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.515112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.515387 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.533911 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:22.535129 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:22.542910 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1433/2891] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:22.547878 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.557523 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7626c4f-54ac-4592-8c02-63783996a2e1 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.562058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.563532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.563810 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.564082 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.564802 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:22.565100 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.566720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.578752 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1459/2892] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:32:22.582618 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.591646 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266234-c347-47f6-bc1e-7f6fd341e6fb None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.596831 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.597472 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.597755 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.598067 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.598764 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.600666 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.685705 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1434/2893] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:22 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:22.690323 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.700397 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dfdfa-dc2f-4c76-ac5f-22a7b768df3c admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.754348 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.755028 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.755305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.755580 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.756334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.758281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.878560 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1460/2894] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:22 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:22.882444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.893119 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ef9f-c222-4097-a1c1-6c7eb3d65e18 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.897688 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.898378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.899521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.899521 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.899703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.901368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.915066 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1435/2895] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:22.917097 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.927925 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c27c-ed29-4e52-b064-d0e067c36cc0 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.932903 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.933655 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.933937 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.934247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.934983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.936606 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fd7a-5e43-43d0-97d9-91efb825d3e7 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:22.947016 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1461/2896] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:22.951444 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:22.961852 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5a80-9500-447d-9c97-a90d3cbbf90d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:22.966362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:22.967226 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:22.967514 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:22.967779 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] PATH_INFO: `/v3/projects/b86666d66a9a4ab3a18f2b3411526dc8/users/722465724b7c4699b5ae003650604ba3/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:22.981822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86666d66a9a4ab3a18f2b3411526dc8, user_id=722465724b7c4699b5ae003650604ba3, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:22.984479 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:23.055102 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1436/2897] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:22 2022] PUT /identity/v3/projects/b86666d66a9a4ab3a18f2b3411526dc8/users/722465724b7c4699b5ae003650604ba3/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:23.065792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:23.066139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:23.066413 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:23.093136 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] MFA Rules not processed for user `722465724b7c4699b5ae003650604ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:23.095058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:23.163600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1462/2898] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:23.174997 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:23.176713 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:23.230398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb687-6291-4367-aa1c-2b7504168ca6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:23.233948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b674fd55d7c4ea4bed85a42588278ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:23.234638 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:23.234912 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:23.235185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:23.243399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:23.244806 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe6fa1-995c-4f66-a9f6-cf73efb6f5d4 service cinder] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:23.253325 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1437/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:45.656538 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:45.716865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2011f-6e6d-45a4-a584-6f738e3076da None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:45.721291 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:45.722181 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:45.722509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:45.722725 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] PATH_INFO: `/v3/users/722465724b7c4699b5ae003650604ba3` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:45.723886 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=722465724b7c4699b5ae003650604ba3)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:45.725834 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:45.907832 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722465724b7c4699b5ae003650604ba3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:45.915021 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722465724b7c4699b5ae003650604ba3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:45.915682 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722465724b7c4699b5ae003650604ba3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.003650 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722465724b7c4699b5ae003650604ba3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.004199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722465724b7c4699b5ae003650604ba3'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.021039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1463/2900] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:45 2022] DELETE /identity/v3/users/722465724b7c4699b5ae003650604ba3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:46.025516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:46.025981 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:46.026111 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:46.043700 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:46.044884 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:46.101500 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1438/2901] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:46.110910 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:46.112961 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:46.170776 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716235b-4cbd-4a6d-9657-94ef2a8cf7fe admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:46.174532 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:46.175706 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:46.175983 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:46.176258 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:46.185178 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:46.186647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:46.196438 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1464/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:46.593921 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:46.601100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:46.621458 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ab0eb-19c5-47c8-9000-0719372c62c8 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:46.634992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:46.634992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:46.634992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:46.634992 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] PATH_INFO: `/v3/projects/b86666d66a9a4ab3a18f2b3411526dc8` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:46.636179 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86666d66a9a4ab3a18f2b3411526dc8)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:46.638548 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:46.762778 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86666d66a9a4ab3a18f2b3411526dc8', 'request_id': 'req-0cc8ad53-7694-44e1-8344-68c577c52bf0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.768022 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86666d66a9a4ab3a18f2b3411526dc8', 'request_id': 'req-0cc8ad53-7694-44e1-8344-68c577c52bf0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.860691 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86666d66a9a4ab3a18f2b3411526dc8', 'request_id': 'req-0cc8ad53-7694-44e1-8344-68c577c52bf0'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.872861 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] The token cache is being invalidate because project b86666d66a9a4ab3a18f2b3411526dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:46.873143 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.873760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-0cc8ad53-7694-44e1-8344-68c577c52bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:46.875434 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1439/2903] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:46 2022] DELETE /identity/v3/projects/b86666d66a9a4ab3a18f2b3411526dc8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:47.388242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:47.389641 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:47.403014 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240c70-840f-4b62-ae22-b36112ec6770 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:47.461152 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:47.462036 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:47.462334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:47.462603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] PATH_INFO: `/v3/users/7384fcddf91545959d62687d053ac397` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:47.463792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7384fcddf91545959d62687d053ac397)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:47.465690 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:47.633392 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7384fcddf91545959d62687d053ac397'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:47.639953 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7384fcddf91545959d62687d053ac397'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:47.640679 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7384fcddf91545959d62687d053ac397'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:47.706261 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7384fcddf91545959d62687d053ac397'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:47.706890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7384fcddf91545959d62687d053ac397'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:47.723987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1465/2904] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:32:47 2022] DELETE /identity/v3/users/7384fcddf91545959d62687d053ac397 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:47.728530 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:47.731729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:47.731729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:47.747375 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:47.748556 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:47.804744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1440/2905] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:47.814272 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:47.815647 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:47.872806 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b797-f65d-48e1-b27c-6f6b00870b48 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:47.876563 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:47.877200 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:47.877479 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:47.878334 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:47.887235 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:47.888598 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5f68-18e7-4613-ab97-2d0ec6fa5a89 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:47.898119 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1466/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:48.245158 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.246723 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:48.262035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97a1a-f79e-466f-9250-bf5cb9de788a None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.266822 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.267769 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.268100 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.268976 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] PATH_INFO: `/v3/projects/9b33bfe645d443ffa7941312c09db8af` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.270161 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b33bfe645d443ffa7941312c09db8af)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.272113 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.363049 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b33bfe645d443ffa7941312c09db8af', 'request_id': 'req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:48.368701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b33bfe645d443ffa7941312c09db8af', 'request_id': 'req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:48.426395 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b33bfe645d443ffa7941312c09db8af', 'request_id': 'req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:48.437209 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] The token cache is being invalidate because project 9b33bfe645d443ffa7941312c09db8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86653) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:32:48.437493 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:48.438150 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-5155ff7f-939a-43fa-ad0b-2c3c02f3ffb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:32:48.439672 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1441/2907] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:32:48 2022] DELETE /identity/v3/projects/9b33bfe645d443ffa7941312c09db8af => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:48.445387 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.445830 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.445914 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.463642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:48.464820 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:48.522302 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1467/2908] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:48.529933 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.530247 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.530523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.548986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:48.550221 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:48.558274 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1442/2909] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:48.562393 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.572767 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86845f-a57f-4b44-ac51-204ec712de1c None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.577365 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.578031 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.578316 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.578583 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] PATH_INFO: `/v3/domains` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.579305 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86654) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 14:32:48.579603 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.581719 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.592992 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1468/2910] 10.222.0.26 () {58 vars in 1152 bytes} [Thu May 5 14:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 14:32:48.597777 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.606850 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596508fc-890b-46f0-aacc-9de3f7da6924 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.615410 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.616197 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.616491 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.618035 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.618760 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.620703 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.695744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1443/2911] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:48 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:48.699808 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.710350 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598721b9-6b14-430e-8c16-140312b0ebdc admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.764078 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.764731 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.765009 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.765281 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.765956 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.767900 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.838363 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1469/2912] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:48 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:48.842376 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.853210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb76a4-da7c-41a7-9357-f6482f5f5ce6 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.857857 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.858545 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.864185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.864185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.864185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.864185 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.872993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1444/2913] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:48.876991 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.887231 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b580248-bd92-42a3-a551-3abf6d49b5b5 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.892040 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.892681 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.892959 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.893926 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.894729 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.896340 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae1ae-91f8-4dd3-8e53-0dcfe9b2da9d admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:48.906242 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1470/2914] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:48.910271 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:48.920057 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f43fb-5a89-4035-a9b5-9f1c596f76a7 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:48.925106 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:48.925968 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:48.926280 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:48.926555 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] PATH_INFO: `/v3/projects/7a084d2891c54840b90480c5b8aa4e6a/users/45c51cdca57f49ad98a58c9affb7e6b8/roles/b7a58b4c991b4594847a1560389a3510` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:48.941346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a084d2891c54840b90480c5b8aa4e6a, user_id=45c51cdca57f49ad98a58c9affb7e6b8, role_id=b7a58b4c991b4594847a1560389a3510)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:48.944062 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:49.014313 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1445/2915] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:48 2022] PUT /identity/v3/projects/7a084d2891c54840b90480c5b8aa4e6a/users/45c51cdca57f49ad98a58c9affb7e6b8/roles/b7a58b4c991b4594847a1560389a3510 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:49.019246 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:49.019600 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:49.019880 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:49.037283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] MFA Rules not processed for user `97db43a40c2a4364b17888ab2b4ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:49.038483 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:49.095039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1471/2916] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:49.105095 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:49.106796 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:49.164980 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48213-81cc-4495-a244-85af73dde4f8 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:49.168623 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:49.169257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:49.169537 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:49.169811 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:49.179210 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:49.180635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f116d-4193-4615-9f62-292c7dbcb979 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:49.189847 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1446/2917] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:49.401111 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:49.402498 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:49.485409 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff74c-3469-4681-9c57-38a472b5aff5 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:49.491436 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:49.492472 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:49.492765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:49.493039 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:49.494881 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:49.507257 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:49.508920 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:49.519569 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1472/2918] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:32:54.180164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.180641 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.180744 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.208625 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.auth.core [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] MFA Rules not processed for user `45c51cdca57f49ad98a58c9affb7e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86653) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:54.209836 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:54.275088 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1447/2919] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:54.279509 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.290486 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d705bd1-d7b2-48e5-bc88-b7322f6cf1c4 service placement] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.294890 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.296500 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.296784 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.297058 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] PATH_INFO: `/v3/projects` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.297940 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.300503 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.387588 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1473/2920] 10.222.0.26 () {60 vars in 1152 bytes} [Thu May 5 14:32:54 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 14:32:54.388130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.400196 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2d8f-02b4-4b77-8343-cfab0ff76ac1 None None] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.458580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.459255 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] REQUEST_METHOD: `POST` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.459535 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.459814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] PATH_INFO: `/v3/users` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.460507 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.462445 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.529079 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1448/2921] 10.222.0.26 () {60 vars in 1143 bytes} [Thu May 5 14:32:54 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 14:32:54.533037 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.543874 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e657f-1bc4-4110-adc0-c9f60ecec077 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.548623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.549283 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.550199 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.550505 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.551263 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.552865 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.563276 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1474/2922] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:54.567417 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.577291 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce792ea-b71d-4739-869d-42ee5a4dfa3c admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.581875 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.582828 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.583133 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.583409 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] PATH_INFO: `/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2/users/e2a7f71b29bb403c8f8bd1d6cd7424e6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.598948 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce96dc4a67aa4a079caa1c9041ba48e2, user_id=e2a7f71b29bb403c8f8bd1d6cd7424e6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.601589 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.695913 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1449/2923] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:54 2022] PUT /identity/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2/users/e2a7f71b29bb403c8f8bd1d6cd7424e6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:54.699889 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.710106 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de39f5-c949-470d-9e7c-9bbbb7071d63 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.765197 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.765847 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.766154 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.766425 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.767139 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.769331 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa1b8b-ec52-4813-a934-68ca62df1f9b admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.778619 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1475/2924] 10.222.0.26 () {58 vars in 1121 bytes} [Thu May 5 14:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 14:32:54.782786 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:54.792770 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9b7f6-d33d-4bfc-a313-ee2e44d30745 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:32:54.797287 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:32:54.798702 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:54.799162 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:54.799595 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] PATH_INFO: `/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2/users/e2a7f71b29bb403c8f8bd1d6cd7424e6/roles/3181dfff2bfd45d7a93875a9f86af19f` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:54.802580 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce96dc4a67aa4a079caa1c9041ba48e2, user_id=e2a7f71b29bb403c8f8bd1d6cd7424e6, role_id=3181dfff2bfd45d7a93875a9f86af19f)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:32:54.805293 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:32:54.818497 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1450/2925] 10.222.0.26 () {60 vars in 1482 bytes} [Thu May 5 14:32:54 2022] PUT /identity/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2/users/e2a7f71b29bb403c8f8bd1d6cd7424e6/roles/3181dfff2bfd45d7a93875a9f86af19f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:32:59.818713 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef324b9-5248-4800-a444-1bb726c58128 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:32:59.819247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef324b9-5248-4800-a444-1bb726c58128 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:32:59.819247 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef324b9-5248-4800-a444-1bb726c58128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:32:59.846565 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7ef324b9-5248-4800-a444-1bb726c58128 None None] MFA Rules not processed for user `e2a7f71b29bb403c8f8bd1d6cd7424e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:32:59.847710 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7ef324b9-5248-4800-a444-1bb726c58128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:32:59.915575 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1476/2926] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:32:59.928628 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:32:59.931385 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:00.011536 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c264-1113-417c-a4b3-2f81643589a2 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:00.017070 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:00.017742 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:00.018043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:00.018939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:00.076131 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:00.077736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:00.086940 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1451/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:19.018458 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:19.018922 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:19.019011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:19.038821 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] MFA Rules not processed for user `45c51cdca57f49ad98a58c9affb7e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:33:19.040053 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:19.046967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1477/2928] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:33:19.346727 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:19.404112 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc767-2089-4f0e-ba32-0e9112ba33c3 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:19.407690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:19.408345 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:19.408621 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:19.408889 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:19.410681 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:19.419849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:19.421257 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:19.428975 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1452/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:20.151857 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:20.153253 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:20.162284 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:20.171557 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2890ef-fc86-4944-98cc-5ca40a638262 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:20.175178 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:20.175849 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:20.176130 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:20.176404 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:20.178251 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:20.192268 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:20.193701 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:20.204967 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1453/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:20.227550 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525acb-a0a2-4b44-bdb0-7995d73f4c9f None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:20.232333 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:20.233032 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:20.233308 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:20.233577 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:20.235343 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:20.247893 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:20.249454 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:20.259150 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1478/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:23.992932 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:24.005359 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d58af-a35c-4c49-8c96-179909f103e3 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:24.013549 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:24.014690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:24.014803 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:24.015031 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:24.017019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:24.031659 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:24.033552 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:24.045587 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1454/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:35.495823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:35.497379 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:35.512396 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034b39-7ddf-4335-9bfb-5ddfccbf1e8e service placement] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:35.517826 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:35.518496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:35.518772 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:35.519043 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:35.520793 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:33:35.534921 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:35.536586 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575505e-6a9d-4169-9b7f-f1fc2edcd6cd service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:35.547613 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1479/2933] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:33:38.038767 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:33:38.047882 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d88c6-c219-455a-af56-e9931d9336c6 service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:33:38.051451 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:33:38.052078 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:33:38.052360 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:33:38.052635 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:33:38.061317 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:33:38.062759 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:33:38.072484 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1455/2934] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:35:40.255249 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc5ad0-bdbf-45a6-96b1-084a22103eec None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:35:40.255746 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc5ad0-bdbf-45a6-96b1-084a22103eec None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:35:40.255836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc5ad0-bdbf-45a6-96b1-084a22103eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:35:40.273838 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-b1fc5ad0-bdbf-45a6-96b1-084a22103eec None None] MFA Rules not processed for user `45c51cdca57f49ad98a58c9affb7e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:35:40.275054 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-b1fc5ad0-bdbf-45a6-96b1-084a22103eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:35:40.281836 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1480/2935] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:35:54.318961 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:35:54.320368 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:35:54.343235 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf319e-505d-47e4-bc41-6f32c48d3637 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:35:54.346891 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:35:54.347516 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:35:54.347790 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:35:54.348059 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:35:54.349729 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:35:54.359490 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:35:54.360899 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:35:54.368780 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1456/2936] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:35:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:37:34.164099 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] REQUEST_METHOD: `POST` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:37:34.164642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:37:34.164642 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:37:34.182320 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.auth.core [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] MFA Rules not processed for user `45c51cdca57f49ad98a58c9affb7e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86654) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 14:37:34.183490 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:37:34.190293 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1481/2937] 10.222.0.26 () {58 vars in 957 bytes} [Thu May 5 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 14:37:34.489989 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:37:34.498380 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e300e0-bf68-425a-b5be-ae28673b67b1 service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:37:34.502120 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:37:34.502739 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:37:34.503019 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:37:34.503288 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:37:34.505605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:37:34.524269 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:37:34.525671 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:37:34.533441 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1457/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:37:35.225221 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:37:35.234659 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbd90c-a422-4109-9e84-e828c3fd9b64 None None] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:37:35.238173 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:37:35.238804 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:37:35.239079 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:37:35.239347 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:37:35.241075 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:37:35.268388 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:37:35.271212 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:37:35.282553 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1482/2939] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:37:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 14:37:53.400986 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:37:53.446707 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057248-13a3-4bc6-ba0b-a926fbea4dba service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:37:53.451746 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087636-6c65-454d-a710-86826160b12e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:37:53.452378 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087636-6c65-454d-a710-86826160b12e service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:37:53.452655 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087636-6c65-454d-a710-86826160b12e service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:37:53.452927 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087636-6c65-454d-a710-86826160b12e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:37:53.461947 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55087636-6c65-454d-a710-86826160b12e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:37:53.463706 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55087636-6c65-454d-a710-86826160b12e service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:37:53.474675 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1458/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:37:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:37:54.764624 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:37:54.797381 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12292-16c1-4a6b-89f0-89d62bc9be7f service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:37:54.803441 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:37:54.804087 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:37:54.804367 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:37:54.804638 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:37:54.806446 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:37:54.818967 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:37:54.820542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:37:54.831069 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1483/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:37:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:39:33.507993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087636-6c65-454d-a710-86826160b12e service placement] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:33.517371 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087636-6c65-454d-a710-86826160b12e service placement] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:33.526171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:33.526171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:33.526171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:33.526171 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:33.530585 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:33.531990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:33.541397 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1459/2942] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:39:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:39:34.790275 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:34.799630 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fb193-7fa0-4c14-801a-548a8c67bbe9 service nova] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:34.803353 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:34.803987 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:34.804269 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:34.804542 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:34.815217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:34.816648 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:34.828098 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1484/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:39:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:39:36.796814 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:36.808939 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecde0b4-820b-4e27-973d-21e3ad60c11e service neutron] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:36.814338 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7140d54b537b43f588f282cd39120eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:36.815028 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:36.815303 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:36.815572 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:36.824851 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:36.829690 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:36.837432 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1460/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:39:48.014673 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:48.024080 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12254-6d27-4642-a4be-0f320b9c6805 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:48.028762 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e3032053704bdb8283b139a95d1817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:48.029720 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:48.030327 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:48.030823 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:48.112217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:48.115064 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:48.137977 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1485/2945] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 14:39:55.191993 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:55.202868 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7f06-1740-4e2f-8d44-7d9d38ae6bcc service nova] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:55.207622 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:55.208487 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:55.208768 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:55.209043 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] PATH_INFO: `/v3/users/45c51cdca57f49ad98a58c9affb7e6b8` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:55.210265 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c51cdca57f49ad98a58c9affb7e6b8)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:55.212346 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:55.387394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c51cdca57f49ad98a58c9affb7e6b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.394090 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c51cdca57f49ad98a58c9affb7e6b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.394736 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c51cdca57f49ad98a58c9affb7e6b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.395399 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c51cdca57f49ad98a58c9affb7e6b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.499394 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c51cdca57f49ad98a58c9affb7e6b8'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.517127 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1461/2946] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:39:55 2022] DELETE /identity/v3/users/45c51cdca57f49ad98a58c9affb7e6b8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:39:55.786816 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:55.798496 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45a17-5cc0-4fce-9ff8-ffdca11b16d9 service neutron] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:55.862854 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:55.864309 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:55.864593 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:55.865029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] PATH_INFO: `/v3/projects/7a084d2891c54840b90480c5b8aa4e6a` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:55.866260 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a084d2891c54840b90480c5b8aa4e6a)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:55.868449 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:55.989811 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a084d2891c54840b90480c5b8aa4e6a', 'request_id': 'req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:55.994998 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a084d2891c54840b90480c5b8aa4e6a', 'request_id': 'req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.064470 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a084d2891c54840b90480c5b8aa4e6a', 'request_id': 'req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.087751 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] The token cache is being invalidate because project 7a084d2891c54840b90480c5b8aa4e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:39:56.088029 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.088635 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.090217 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1486/2947] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:39:55 2022] DELETE /identity/v3/projects/7a084d2891c54840b90480c5b8aa4e6a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:39:56.094246 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:56.095619 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:39:56.109152 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee64fd-8621-4fed-9644-8c9c90f169d5 admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:56.173854 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:56.174783 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:56.175064 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:56.175334 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] PATH_INFO: `/v3/users/e2a7f71b29bb403c8f8bd1d6cd7424e6` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:56.176518 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a7f71b29bb403c8f8bd1d6cd7424e6)` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:56.178605 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:56.448990 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a7f71b29bb403c8f8bd1d6cd7424e6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.455888 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a7f71b29bb403c8f8bd1d6cd7424e6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.456553 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a7f71b29bb403c8f8bd1d6cd7424e6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.457164 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a7f71b29bb403c8f8bd1d6cd7424e6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.544704 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.notifications [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a7f71b29bb403c8f8bd1d6cd7424e6'} {{(pid=86653) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:56.561576 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1462/2948] 10.222.0.26 () {58 vars in 1223 bytes} [Thu May 5 14:39:56 2022] DELETE /identity/v3/users/e2a7f71b29bb403c8f8bd1d6cd7424e6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 14:39:56.820689 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Authenticating user token {{(pid=86654) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:39:56.822765 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.fernet_utils [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86654) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:39:56.835737 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d4e73-e9eb-4deb-b480-0c8bd624f9e8 admin admin] Validating token access rules against request {{(pid=86654) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:39:56.892372 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97db43a40c2a4364b17888ab2b4ef553', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c80cec912494f1282aea1889f985885', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86654) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:39:56.893234 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:39:56.893517 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] SCRIPT_NAME: `/identity` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:39:56.893792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] PATH_INFO: `/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2` {{(pid=86654) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:39:56.895011 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce96dc4a67aa4a079caa1c9041ba48e2)` {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:39:56.898792 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] RBAC: Authorization granted {{(pid=86654) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:39:56.995000 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce96dc4a67aa4a079caa1c9041ba48e2', 'request_id': 'req-61832040-68ef-40fc-963e-abd2d42b742e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:57.000319 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce96dc4a67aa4a079caa1c9041ba48e2', 'request_id': 'req-61832040-68ef-40fc-963e-abd2d42b742e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:57.064975 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce96dc4a67aa4a079caa1c9041ba48e2', 'request_id': 'req-61832040-68ef-40fc-963e-abd2d42b742e'} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:57.076623 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] The token cache is being invalidate because project ce96dc4a67aa4a079caa1c9041ba48e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86654) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 14:39:57.076941 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:57.077581 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: DEBUG keystone.notifications [None req-61832040-68ef-40fc-963e-abd2d42b742e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86654) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 14:39:57.079157 dv-cinder-737618-3-iscsi devstack@keystone.service[86654]: [pid: 86654|app: 0|req: 1487/2949] 10.222.0.26 () {58 vars in 1232 bytes} [Thu May 5 14:39:56 2022] DELETE /identity/v3/projects/ce96dc4a67aa4a079caa1c9041ba48e2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 14:42:55.411964 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Authenticating user token {{(pid=86653) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 14:42:55.413362 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:55.511398 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818b75-d21e-407f-950b-60d2d7c6a43d admin admin] Validating token access rules against request {{(pid=86653) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 14:42:55.566566 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f322aed419054297851d892da1249ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac9e5a3bf3e545529ab911da547b4211', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86653) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 14:42:55.567242 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] REQUEST_METHOD: `GET` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 14:42:55.567523 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] SCRIPT_NAME: `/identity` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 14:42:55.567799 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86653) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 14:42:55.569550 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.fernet_utils [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86653) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 14:42:55.581367 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 14:42:55.582971 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616a77f-9419-4e59-a795-3b4dad1814b5 service placement] RBAC: Authorization granted {{(pid=86653) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 14:42:55.593364 dv-cinder-737618-3-iscsi devstack@keystone.service[86653]: [pid: 86653|app: 0|req: 1463/2950] 10.222.0.26 () {60 vars in 1365 bytes} [Thu May 5 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)